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ABSTRACT 


Upper and lower bounds on the inherent computational complexity of 
the decision problem for a number of logical theories are established. 

A general form of Ehrenfeucht game technique for deciding theories 
is developed which involves analyzing the expressive power of formulas 
with given quantifier depth. The method allows one to decide the truth 
of sentences by limiting quantifiers to range over finite sets. In 
particular for the theory of integer addition en upper bound of space 
gen 


2 is obtained; this is close to the known lower bound of nondeterministic 


e'n 
time 2? ° 
A general development of decision procedures for theories of product 
structures is presented, which allows one to conclude in most cases that 
if the theory of a structure is elementary recursive, then the theory 
of its weak direct power (as well as other kinds of direct products) 
is elementary recursive. In particular, for the theory of the weak 
direct power of <N,+” , and hence for integer multiplication, an upper 
oe 
bound of space 2? is obtained. The known lower bound is nondeterministic 
2° 'n 
time 2? 
Finally, the complexity of the theories of pairing functions is 
discussed, and it-is shown that no collection of pairing functions 
has an elementary recursive theory. 
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Chapter 1: Introduction and Background 


Section 1: Introduction 


The significance of the distinction between decidable and 
undecidable theories has been blurred by recent results of Meyer and 
Stockmeyer [Mey73,MS72,SM73,Sto74] and Fischer and Rabin [FiR74] who 
have shown that most of the decidable theories known to logicians 
cannot be decided by any algorithm whose computational complexity grows 
less than exponentially with the size of sentences to be decided. In 
many cases even larger lower bounds have been established. In this thesis 
we investigate the computational complexity of a number of different 
logical theories, obtaining decision procedures whose computational 
complexities roughly meet the known lower bounds and deriving a 
new lower bound whose complexity is very close to the known upper 
bound. 

Let N be the set of nonnegative integers. Whether a sentence of 
the first order theory of N under addition is true is decidable 
according to theorem of Presburger [Pre29]. A more efficient decision 
procedure given by Cooper [Coo72] has been proved by Oppen [Opp73] to 
require only 922" steps for sentences of length n, where c is some 
constant. In Chapter 2 we present a fairly general development of 
Ehrenfeucht games [Ehr61] which allows us to show that space 2 = is 


sufficient for deciding Presburger arithmetic. 


Let nN" be the set of functions from N to N of finite support, i.e., 


* 
N ={f: N2N | £(1) = 0 for all but finitely many i € Nj. 
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The structure < N*,- > of positive integere under multiplication is 
* : 
isomorphic to the structure <N , + > (the weak dérect power of <N, +>) 


where addition is defined component-wise, The first order theory of 
this structure is ksown to be decidable by a theorem of Mostoweki. [Mos52]. 
Mostowski's procedure, however, is not elementary recursive in the 


sense of the following definition: 


Definition 1,1: An elementary recursive fupction (on strings or integers) 
is one which can be computed by some Turing Machine within time bounded 


above by a fixed composition of exponential functions of the length of 
the input. (This is showm by Cobham [Cob64] and Ritchie [Rit63] to 
be equivalent to Kalmar's definition [cf. Pet67].) 


In Chapter 3 we use the technique of Fhrenfeucht games to derive 
some general results about the theories of weak direct powers which 
enable us to obtain a new procedure for deciding whether sentences are 
true over < nN’, +>, Our procedure can be implemented on a Turing machine 

sen gc'n 


2 | 
2 tape squares (and hence 2? steps) on 


which uses at most 2 
sentences of length n. As a corcollary we obtain the same upper bound on 
decision procedures for the first order theory of finite abelian soon: 
Recent results of Fischer and Rabin [FiR74] show that for some constant c" > 0, 
any procedure for the first order theory of < XN, + > requires time 


en 
even on nondeterministic Turing machines. Thus (see Sections 2 and 3) 


2 
22 


os 


the worst case behavior of our procedure for < N‘, +> is assymptotically 
nearly optimal in its computational requirements. 

In Chapter 4 we extend the methods of Chapter 3 in order to obtain 
general results relating the complexities of theories to the complexities 
of their weak direct powers and direct products, thereby obtaining 
computational versions of results of Mostowski [Mos52] and Feferman 
and Vaught [FV59]. In particular we show that the theory of the weak 
(or strong) direct product of a structure is elementary recursive if 
(but not only if) the theory of the structure is elementary recursive and 
if another condition holds; this other condition says roughly that not 
too many sets of k-tuples can be defined in the structure with 
quantifier depth n formulas. 

Chapter 5 is concerned with the computational complexity of pairing 
function structures. A pairing function is a one-one map Pp: N XN ON, 
and the associated structure is <N,p >, Although the theory of the 
set of all pairing functions is undecidable and the theories of some 
individual pairing functions are undecidable, Tenney [Ten74] shows 
that many commonly used ones have decidable theories. Our main result 
is that no nonempty collection of pairing functions has an elementary 
recursive theory. In fact, for some constant c > 0, the theory oF 
any nonempty collection of pairing functions requires time jas height cn 
to decide. 

In Section 2 of this chapter we present the definitions and basic 
theorems of automata theory needed to clarify the basic notions of 


upper and lower time and space bounds used in the following chapters. In 


28 


Section 3 we discuss the reducibility techniques which allow us to 
achieve many of the upper and lower bounds. Section 4 consists of 
a description of the notation and fundamental concepts of mathematical 


logic which will be needed in the rest of the thesis. 
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Section 2: Automata Theory Backgro und 


We shall consider a version of Turing machines which; may be either 
deterministic or nondeterministic, one tape, one. head automata, 
with a finite tape alphabet D. For a rigorous: definition of these. 
machines the reader can consult: [Sto74, Section:.2.2].. For most ef our 
purposes, however, the exact details of the definition chosen do not 
matter very much, so we provide only an informal description. here. 

The tape is one-way infinite to the tent and:.the automaton starts 
in the initial state with its head on the leftmost’ square of the.tape. 
At any step, depending on the current state and the current contents of 
the tape. square scanned by the head, the automaton can write a new 
member of Z on that square, move the head right. or..left, and go into a 
new state. The Turing machine ie deterministic.if ita..actions. at any 
step are completely determined by its state and by. the contents of the 


square pointed at by the head. If the machine -ie: pemleter; 


there may be a finite set of permissible actions possible -at..any moment. 
Thus, the deterministic Turing machines form.a.subset of the nondeterministic 
"ones, 

A (deterministic or nondeterministic) L-automaton M has 2 as the tape 
alphabet; at any moment, all the symbols on the tape are from the 
alphabet 2, BE Z. Let x" be the set of all finite sequences, or 
"strings" of elements of 2 and let xt = = - {\} where \ is the empty 
string. If y €Z', then MR accepts -y if there im-some sequence of. possible 
steps of Mwith the tape squares initially containing the string y#b ... 


and the head scanning the leftmost symbol of y, that ends with an 


-10- 


accepting state. The set L(M) = {y € T M accepts y} is called the 
language recognized by 2. 
We now define whet we mean by the rime and: space weed by Turing 
machines. If R te o (nomdeterministic) Z-Turing machine which accepts 
yé€ = by some computation containing at moat n steps then we say that 
M accepts y within time n. If @ aceepte y by some computation during. 
which the head visits at most n different tape. squares then we say that 
M accepts y within space n. Let L = LGR) andi let f: N+ N. Then we 
say recognizes L withds: time (space) fi(mn) ££ for every y € L, B 
accepts y within time éepace) € (lvl). where {y| as the Length of the 
string y. NTIME(f(n}) (NSPACE(f(n)).) ie the set of. languages: (where 
by language here we mean a subset of Boi for some: alphabet &) each of 
which is recognised by soe nondeterministic Turing machine within 
time (space) f(m). DYIME(f(n}} and DSPACE(f({n)): ave defined similarly 
with respect to deterministic machines. 
In order to compare the upper and lower bounds for the computational 
complexity of the theories we shall consider, it ie necessary to wumderstand - 
certain relationships known to hold between time and space for deterministic 
and nondeterministiec computations. (These uecters ave discussed more fully 


in [Sto?74}.} 


Fact 2.11, Let f: NON. 
A. Nondeterministic vereus deterministic time 
a} DFEME(£(m)} S NTIME(f£(n)) 
b) NTIME(£(n)) © Lptimm(e*™)), 
cen 


ee 


B. Nondeterministic versus deterministic space 
a) DSPACE(£(n)) © NSPACE(f£(n)) 


b) NSPACE(£(n)) S DSPACE((£(n))*) 


C. Time versus space 
a) DTIME(f£(n)) | DSPACE(f(n)) 
NTIME(£(n)) S NSPACE(£(n)) 


b) NSPACE(£(n)) © Uprime(e! 
cENn 


All of Fact 2.1 is relatively straightforward to prove, with the 
exception of B.b. B.b is proved by Savitch [Sav72]. By (B), if we 
are discussing a lower or upper bound of the form "space 2 for some 
constant c'' it is unnecessary to specify if we are talking about deterministic 
or nondeterpinistic space, Similarly, we can talk about a bound of the 


en height cn - 
form ''2 for some constant c without specifying if we are 


talking about time or space, either deterministically or nondeterministically. 


Each of the gaps between a) and b) in A, B, C above represent 


important open questions of automata theory. 


Section 3: Using Reduetbilities to Prove Upper amd Lo ‘Bounds 


Definition 3.1: Let z, and Ly be finite alphabets and let L, zy 
and L, © Zt, Then L, <, L, if for some function g: rte ot 
iad ae i gb 2 os i 


I) for all y € Ey, YEL, @ ely) € Ly and 


II) there is some Turing machine which computes g within time a 
fixed polynomial in the length of the input and within space linear in 


the length of the input. 
* 
If S is a collection of languages over q (i p@,)), then we say 
$= oals if. Ls yh for all L€S. 


We now state Lemma 3.2, which is a very powerful way of proving 
lower and upper bounds. For a preof (which is really very simple) of 
this fact and for a very thorough discussion of reducibilities, see 


[Sto74]. 


Lemma 3.2: Say that Ly s pita: Let f: NAN. If 


DTIME(£(n)) - DTIME(£(en) + p(n)) 
DSPACE(£(n)) DSPACE(f(cn) + n) 
Ly ¢ wrme(f(ny)) * “PEP EL © 5 remece(en) + p(n) 


NSPACE(f£(n)) ~\\ NSPACE(£(en) + n) 


for some constant c > 0 and polynomial p(n). 


: A deterministic Turing machine computes g if when it is started with 
y0¥ ... on ite tape, y € 1» and its head on the leftmost square, it 


eventually halts and g(y) is the string on the tape to left of the head. 
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Contrapositively, if 


DTIME(£(n) + p(n)) 3 DTIME(‘£(en)) 
DSPACE(£(n) +n). ( pgpace(£(en)) 
L, ¢ NTIME(£(n) + p(n) “PE? 2a * ) wermececen)) 
NSPACE(£(n) + n) NSPACE(£(cn)) 


for some constant c > 0 and some polynomial Pp. 


An example of the way we use Lemma 3.2 is the following: say that 
oer 


we have languages Ly and L,. such that we know that Ly € SPACE(2" ..) for 


cn 
some constant c. If L, s pote then we can conclude that Ly € SPACE(2” ) 


e'n 
for some constant c. If we know that Ly ¢g NTIME (27 ) for some 


constant c’ > 0, and if L, s pita? then we can conclude that 


,c'n 
Ly ¢ NTIME (27 ) for some constant c' > of This latter idea is often 


used in conjunction. with Lemma 3.3. 


Lemma 3,3:(see[Co73,SFM73Sei74].) Let f: N +N be one of the functions 
2 


wan e 
n 2 A ‘ 
a 2? ; 2? >» or 2? = "Then there exists a language L such that 


L € NTIME(£(n)) and L ¢ NTIME(£(n/2)). : 


n 52° » _ height n 
Theorem 3.4: Let f£: N > N be one of the functions yan 2” 2° or 2? ‘ 


and let L, & > (for some > ) be such that NITHE(£(n)) < pe ab 


0 0° then for 


some constant c > 0, Lo ¢ NTIME(£(cn)). 


i It is easy to see that if L ¢ NTIME(£(n));: them any nondeterministic 


Turing machine which recognizes L takes time at least f(n) on some 
y € L of length n, for infinitely many n.. 


lhe 
Proof: Say that NTIME(f(n)) + peto- By Lemma 3.3, let L be such that 


L ¢ NTIME(f(n/2)) and L € NTIME(f(n)). So L*< ptly: By Lemma 3.2, 


Ly ¢ NTIME(f(cn)) for some constant c > 0. 0 


A typical way Theorem 3.4 is used is the following. Fischer and 
Rabin [FiR74] show that if TH is the theory of integer addition, then © 


n cn 
NTIME (27 )<s patie concluding that TH ¢ rime (27 +) for constant c. 


| | c'n 
In Chapter 2 we show thet TH € SPACE (27 ) for some constant c’, and 


{ 
gc'n 
hence that TH € DTIME(2” ) for some constant c‘. 
A natural question is whether or not we can get a DTIME upper 
bound for TH and an NTIME lower bound for TH which are closer to 


t 
o = cn 
each other than are 2" 9 and 2° . If we could, this would settle 


an important open question of automata theory. 7 tor instance, say that 


we could show that TH € DTIME (22 }) for some constant c', Since 
a 


NTIME(2” ) < pa™s Lemma 3.2 would eae that wre (2? a <c U DTTME (27 +. 
. a | 


narrowing the gap in Fact 2.1, A. This would also contradict the popular 


conjecture that (for most functions 7 that are encountered) cherie is a 
language in NTIME(f(n)) which requires pre (ce!) ) for some constant c. 
The reason therefore that we have not been able to narrow the gap between 
our DTIME upper bound and NTIME lower bound for TH, ia not. beceuse we do 
not mdecetand the encessive power wi other properties of mH, but 
cather because we ‘don’ t understand many. basic properties of the very 


notions of deterministic and nondeterministic computation. 
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Section 4: Mathematical Logic Background and Notation: 


Most of the notation of mathematical logic that we shall use is 
fairly standard; the reader can find woaetee definitions of those 
concepts not defined here in [Men64]. | 

‘£ will always represent a language of the first order predicate 


calculus with a finite number of relational symbols Ry» Ro» ooes Ry 
where Ry will be a t,-place formal predicate for 1 <is< dh. For 
technical convenience, £ will not contain function symbols. Sometimes 


we will choose £ to have a constant symbol e as well. The formal 


variables of £ are written a8 X, X4> X09? *11° ooo, that is, the 
subscripts are written in binary. For expository convenience, we will refer to 


distinct formal variables as X,XqoXy sor coos VsVqrTy> over Bs2 284s cs 


WW Wy scene , x',y',B', oe « 
The atomic formulas of { are strings of the ome Vir taeeoo%e.) 


where Vy9Vo> cos V, Tepresent (not necessarily distinct) formal 


fy 


variables; if £ has a constant symbol e, then each v,, 1 < j < i, can 


4’ 
represent either a formal variable or e. We define the formulas of £ 


recursively as follows: Atomic formulas are formilas; if Fy and F, are 


formulas and v is a formal variable, then’ each of the strings 


1 abo AG eater ter 
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is a formilas’ We use the usual notions of an occurrence of a 
variable in a formula being bound or. free, and define a sentence af | 


“ to be a formula in which there are no free occurrences of variables. 


aya : 


A structure for £ is a tuple $ = <S, Ri» Sie Re > where S is a 


t 


set and R, eg i 


for 1 < i < £; if £ has a constant symbol e, then a 
structure for £ is <S$ Ri» seo, Ry, @ > where e € S. We call S the 
9 me . 


domain of 8. If F is a sentence of £ we will use the usual notion of _ 


F true in 8 or S$ satisfies F or F holds in 8, and we will write this 


S& + F. Sometimes we will say "F is true" or "F holds" or merely assert 
"F" when 8 is understood. TH(S).= the theory of 3 = {F | F is a sentence 


and 3 + F}. If P is a nonempty colleetion of structures, then define 


‘ When writing formulas we will omit parentheses when it will not lead to 


confusion. 
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TH(P) = theory of P= SN THB). 
8EP 


Our language & would have been Riek as power ful had we left out — 
much of our logical notation. For instance x V : ere 
~x > y and VxF is equivalent to ~“lxF. It is only ne convenience 
that we have made : ig ates as we have. 

We say a formula F is a Reaiean coubinat ion of subformulas 


Fi» Fos oes Fe if F is obtained by combining F Fos seo, FE 


1? k 


using perhaps A, V, *,@, ~ but no quantifiers. Clearly every formula 
is equivalent to a Boolean combination of formulas, each of which begins 
with an existential quantifier. 

We now define annotated formulas in order to be able to talk about 
‘substituting members of a domain for free occurrences of variables, and 
in order to be able to talk about the relations defined by formulas. Let 
F bea formula and say that we have a sequence of formal variables — 


containing (not necessarily exclusively) the variables which occur 


freely in F, say Kyo Xoo eoes Keo We define the annotated formula 

F(x, Xoo cee, x) to be, formally, the ordered pair consisting of F and 
the sequence Ryo Koo sees He Informally, when we write F(x,» Kos. sees x) 
we think of ourselves as associating with the formula F the sequence 


Ks Xs sees Xe We will usually use F and F(x), Xo» eae x) inter- 


changeably, and call them beth formulas, as long as this association is 
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understood; we will never associate two different sequences with the 
same formula. 


Say that F(x), Kyo sees x) is an (annotated) formula and § is a 


structure with domain S, and ay € Ss. By F(a); Koo sees x) we will mean 


1 for free occurrences of x 


the formula obtained by substituting a 
in F. Note that this is technically not a formula of £ but rather a 


(non-annotated) formula in the language £' obtained by adding constant 


symbols to £ for every member of S. If Ays Ags coos a € S, then 
F(ay, Ans sees a.) is defined similarly, and we write 
& F F(a); Aor sees a) if F(a), Ags sees a.) is true in 8, 
For k > 0, we use x, to represent the k-tuple (X15 Kos sees Xs a, 


to represent (a> Ags cess a)» (a, b) to represent (ay> Bos coos As b), 


etc. Thus F(x,) will be used instead of F(x), Kos sees x) etc. Ps 


and o will stand for the k-tuples (e, e, ..., e) and(e, e, ..., e)- 


sk is the set of k-tuples of members of S. cs* is isomorphic to the set 


of functions from {0, 1, 2, ..., k-1} to S.) For k = 0, sk is taken to 
be the singleton set containing the empty set, and a A etc., 


denote the empty set. However, we take (a, 5b,c) to mean (b,c) when k = 0, etc. 
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If we write F(x,) when k = 0, then F is a sentence; F(x,), F(a,), etc., 
are in this case no different than F itself. 
If S is a structure with domain S and AS sk and F(x,) is an 


annotated formula, then we say F defines A in 8 if 
A= (a, © s* | Sb F(a,)}- We say "F defines A" if 8 is understood. 
More generally, say that we are interested in a particular nonempty 


class of structures P. By a k-place property G we mean a function which 
assigns to each structure S € P a subset of sk (where § is the demain of 
8); we will usually refer to the value of G on $ 4s the relation G 


restricted to 8. If a € sk then we write 8 + GCa,) to mean that a, € 


the relation obtained by restricting G to 8, When Gis a property we 
sometimes write G(x,) to indicate that G is a k-place property. Tf 
G(x,) is a formula, we say that G defines G in P if in every 8 CP, 


G defines G restricted to 38. We say "G defines G" when P is understood. 


Formulas F, and F, are equivalent in § if for some sequence 
Xy> Xo eves x, of variables, the free: variables of both Fy and Fo are 
from among er and the annotated formulas F(x) and F,(x,) 
define the same subset of gk. Fy and Fy are equivalent in P if they are 


equivalent in every member of P, We say "Fy and Fo are equivalent" to 


mean with respect to the class of all structures, unless 8 or P 
is understood. 

_ Since we shall be interested in Turing machines whose input 
strings are sentences of £, we have to have a pectae notion of the 
alphabet used to write formulas and a precise netion of the length of 


formulas. Our alphabet consists of 5 = {(, ), A, V, #9, 3, V, ®, x, 0, 1,} 


(where 0 and 1 are used to write subscripts of variables and relation 
symbols); if e is a symbol of S, then e € Z also. If F is a forma, then 
by the length of F, written |F|, we will simply mean the length of ¥ as 
Y 
a member of 2. 
Another usage of the notation F(x,, x), +++» %) serves to 


emphasize that the free variables of F are from among Kyo Xqs coos Hye 


For instance, the more mmemonic notation dx, F(x,) will sometimes be 


used instead of ax F. If we write [Pcx,)| we simply mean lF 


Notation: If a is a string, then lal is the length of a. If aw is a set, 
then | al is the cardinality of a If aw is an integer, then | a is the 
absolute value of a. nt is the set of positive integers. For i € n’, 
Q, will always represent a quantifier, i.e., either Voor ad, Ail 


logarithms are to the base 2. 


Definition 4.1: A formula F is in prenex normal form if it is of the 


form Q1%4%%5 re QF where F' is quantifier free and Vys Vos coos Wy 
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represent formal variables. 


Theorem 4.2: Every formula F is equivalent to a formula G in prenex 


normal form such that G has at most |F| quantifiers and is of length 


at most lr *log|F . Furthermore, there is a procedure (i.e., Turing 


machine) which given F computes G within time polynomial in lr 


Proof: There is a standard procedure for converting a formulato one in 
prenex normal form [Men64]. The procedure basically just "pulls out" 
the quantifiers to the front, except that first the names of certain 
variables have to be changed in order for the procedure to produce a 
formula equivalent to the initial one. The procedure does not change 
the number of quantifiers, so G has at most | F| quantifiers. F has at 
most |r| occurrences of variables, - if these are given all different 
names (in the worst case) and the binary subscripts are chosen to be 
as short as possible, then F grows by a factor of at most log | F when 
put in prenex normal form. This procedure can be checked to operate 
within polynomial time. a 
Thus, to show that a theory can be decided within space f(cn) for 
some constant c, where f grows faster than polynomially, it is 
sufficient to give a procedure which decides the truth of prenex normal 
form sentences of length at most n log n with at most n quantifiers, 


within space f(cn) for some constant c. 


=D 


Definition 4.3: If F is a formula, we will write q-depth(F) to mean 
the quantifier depth of F. Formally, if F is an atomic formula then 


q-depth(F) = 0; if F, and Fy are formulas then 


1 
q-depth(F, Vv Fy) = q-depth(F, A F,) = q-depth(F, > Fo) = q-depth(F, @ F,) = 
Max{q-depth(F,), q-cepth(F.,)}, q-depth(~F, )= q-depth(F,), and 


q-depth({vF, )= q-depth(VvF, )= 1+ q-depth(F,). 
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Section 1: Introduction 


In this chapter we present a development of the Ehrenfeucht game ap- 
proach to deciding logical theories. This approach was originally 
described in [Ehr61], and in particular the reader may wish to consult 
this source to learn about the relationship to game theory. A discussion 
of game theory also appears in work by Richard Tenney [Ten74,Ten74']. Tenney 
uses Ehrenfeucht game techniques to decide the theories of certain 
pairing functions and to decide the second order theory of an equivalence 
Swieeion: Neither Ehrenfeucht nor Tenney explicitly describes these 
techniques in generality. We shall present a development in this chapter 
which, although not completely general, is panaear enough to handle a 
wide variety of cases. Where possible we will describe our decision 
procedures in terms of bounds on quantifiers, so that to decide the truth 
of a sentence one need only decide the sentence when each quantifier is 
limited to range over a particular finite set. This idea, which will be 
carefully described in the next three chapters, is also used by Tenny, 
Ferrante and Rackoff [FR74], and Ferrante [Fer74]. In addition, as part 
of our development of the Ehrenfeucht game approach we shall characterize 
it in terms of the quantifier depth of formulas. 

Section 2 of this chapter consists of a general development of 
Ehrenfeucht games. Our approach is somewhat different from that of 
Ehrenfeucht or Tenney, but several of the basic theorems and ideas come 


from these sources. In Section 3 we derive a decision procedure for 


tis 


the first order theory of integer addition as a corollary of our 
general development, In Section 4 we discuss an important open 
question relating the complexity of decision procedures to the index 


of the equivalence relation which characterizes Ehrenfeucht games. 
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Section 2: The Ehrenfeucht Equivalence Relation and Ehrenfeucht’ Games 


Let & be a fixed language of the first order predicate calculus 
with finitely many relational symbols R, Ry5-++ Ry where R, is at,- 
place formal predicate for 1sis%. Also, let £ have a single constant 


symbol e. Let S=<S, R RoseooRy,e€> be a fixed structure for £, 


1’ 
(Actually, the constant symbol e plays no {important role in this chapter 
but fs included so that we can talk about weak’ direct powers — later.) 
In addition we will assume we have a norm on 8, by which we mean a 
function || ||:S9N, and we will denote the norm of a€S by |lal]. 

If 1€N, then we write a<i to mean ||a{| <i. We igitroduce this concept 
of norm in order to describe simple decision procedures which use space 
efficiently (and without a significattt time loss). © However the reader 


should note that many of the theorems below make no mention of the norm 


and are independent of this notion. . 
We now define the Ehrenfeucht equivalence relation. 


Definition 2.1: For all n,k€N and all a sb, € e*, define ay b, iff 


Bill 
roe 


for every formula F(x,) of q-depth=n, F(a.) and F(b,) are either both 


true or both false (in 8). 


Remark 2.2: For each n,k€N, is an equivalence relation on s*, 


n 
Ehrenfeucht originally defined . by induction on n; his definition 


consisted of a combination of our definition of g together with what 


we call Theorem 2.3. We will prove this theorem later. 


? oe k ee Wee 
Theorem 2.3: Let n,k€N and arb, €S - Then a =, by 


1) For each aay €S there exists some b 1° S such that ay 


k+ 


k+1° 
“ € 7 * 
and 2) For each wel €S there exists some are] S such that aay 


k+1° 


ou oi 
ott OF 
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Lemma 2.4: Let n,k€N and a, »b, € sk such that 


oe 


1) For each a © 8 there exists some bya FS such that Sa KHL’ 


ail 
ot 


sill 


and 2) For each b, ,,€S there exists some ay i S§ such that ay. +1 


k+1 k+1° 


en a, 71 > 


Proof: Say that 1) and 2) hold. Since every formula is equivalent to 


a Boolean combination of formulas each of which begins with an existential 


quantifier, it is sufficient to prove, for F(x) of the form we] C41) 


where q-depth(G) <n, that F (a) oF (b,). 


So assume that F(a,) holds. Then let “cst ° S be such that Gla) 
holds. By 1), let b,,,€S be such that a 2 Poa Since C(a,,,) is 
true, G( Biya) is true (by definition of =), 89 Fb) is true. By 


symmetry, F(a) holds if F(b,) holds. O 


Definition 2.5: For each n,k€N let M(n,k) be the number of equivalence 


classes of = restricted to s*, 


Lemma 2.6: Let n,kEN, Then M(n,k) is finite and for each a, € st there 


is a formula F(x) of q-depth n such that for all B.es*, 


SrF(b, ) ° b, s a, (i.e., F defines the = equivalence class of a). 


n 

Proof (by induction on n): If n=O and a, €s*, we can clearly take F(x,) 

to be a conjunction of atomic formulas and negations of atomic formulas. 

Since an argument place of an atomic formula can be occupied by either a 

formal variable or by e, the number of atomic formulas in which at most e, 
£ t 

Xj oXpoee+ eX, Occur is 12 EHD) i, So 


$ (ett) Lt 
M(0,k) < 24> 


uo7e 


Now assume the lemma true for n (and .all k). We shall prove it for 


n+1 (and k). Let HG) Fo Beye Eee ett) Hee, be a sequence of 


formulas of q-depth n such that for each a1 © ghtl there exists an i, 


1<5i<M(n,k+1), such that F defines the = equivalence class of Aer - 


i 
For each e, € sk define 


We, a(t | 1<iSM(n,k+1) and ct ey Fy (Cy 41) is true}. We shall show 


= « k - _ oa Seieat ; =] 

Phat er all Busce 8's. Pear Sea MONT yy ee, corm = 

\ F.(x,.,))A fo AL 

ewe,) ee Fe Say 19w(e,) +1 4) Sep 
\ IstM(n, Set) 


_ defines the equivalence class of Se 


n¥l. 
Clearly if b 


k nil Che then GOED + since ‘each formula 


ci wee Fy (Xa) is of qrdepth ml. To: "prove the. converse. we iii prove 


the following Claim. 


Shain: If nO )» then for each c,. a there exists some b, i* 8 


such that Coe a Bey (and by symmetry, for each bey 1&3 there’ -extive’ = 
some Cy E§ such that C4] = Bee 


Proof of Claim: Say that Wh, dane, ) and c.,,€S. Let i, 1<i<M(n,kt), 


tL 
be: auch that F, 1 Fey defines the = equivalence class of Ce F Lc, ap 


is tie: Ye) cae Fy (ey Mg) is true, 80 EWG). So tewe This 
means that ae] F, (by 2% +1) is true, and therefore we can find bey 1 such 
that... By ¢ Pe is: true. Since Fy defines the. = equivelence class of. one 


By the Claim and Lemma 2. 4, WG pwGy i nil ye. fete that the 


equivalence class of cy, is determined by WE) whitch is a subset’ of 
M(n, k+1) | 


ntl 


(2 as M(n,k+1)}. So M(nt1,k) <2 This and the bound on M(0,k) 


r 


=-28= 


9 (ntk)© 
oe | height n+l 


imply that M(n,k) <2? for some constant c. oD 


Remark 2.7: There are structures $ such that 
Hk 
om 


Z le en 
M(n,k) 22 (for some constant €>0), so M(n,k) is not in 
general bounded above by an elementary recursive function. For thany 


structures, however, M(n,k) grows considerably more slowly. 


Definition 2.8: Let Hw? +N be a function which 1s nondecreasing in each . 
argument. Then § is E-bounded iff for all n,k€N and ail F(x) of 
q-depth <n and all a, €s", if ear Oe a1) is true in 8 then - 

[Sey SHC, k » Mex (Ila, I} TF (ay 5%) is true in 8. (We take Max ¢ 

to be 0.) eek 


Remark 2.9: If our norm on S is the identically 0 function and HW oN | 

is the identically 0 hates then clearly 8 is H-bounded. This hecad that 
often when we have a theorem which involves: the concepts of norm pe 
H-boundedness, we can immediately sheath a simpler theorem which doesn't 
mention those concepts; sometimes, as is the iat with ‘Lema ‘2. 10, this 


new result is still interesting. 


Lemma 2.10: Let HIN? aN be such that $ is bounded. Let n,k En and . 
let a, +b, € sk such that ay | By Then for each a, .) €s there exists 
some by. 41° Ss such that ae Lael and auch that 


Toy y tl snc, Max (1 1b, 11). 
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a4 ke k S te 
Proof: Let a, sb, € S” such that a, 15) Bye Let a7 & S. By Lemma 2.6 


there is a formula FOG.) of q-depth n which defines the = equivalence 


n 


class of Aaa Since FC ay xy) is true and a ntl bh» 


b - € 
Hy FCb, x1) is true. Since § is H-bounded, we can choose el Ss 


[| su(n,k, Max (||b,[]}). But 


) is true and reer > Set, 


such that F(bpay 


F(b ketD implies ae =a O 


Proof of Theorem 2,3: Theorem 2.3 follows immediately from Lemma 2.10 


(keeping in mind Remark 2.9) and Lemma 2.4. 0 


H-boundedness of a structure guarantees that quantifiers in a 
formula ranging over all of S can be replaced by quantifiers ranging 
over elements of S whose norms are bounded by a function determined by H. 


This is made precise in the following lemma. 


Lemma 2.11: Let H:N? 4 N be such that S is H+bounded. Let n,k€N and 
let Uy QX5 266 Q x, FOX) be a sentence of £ with q-depth<ntk, i.e., 
q-depth(F) <n. Let mm, € Ni be a sequence such that a, Pte ly ee 
for l1sisk. 
Then as) Q4%5 ois Ox, F( x) is true © 

2 < a 
(Q)x) <m,) (Qo <m,). be (Q%, mF (4) is true. 


co 


Proof: Consider the formula Qo*5 Q3%3 6 Q x, FOX). Because o is 
- . > oe : - i 
H-bounded, if m, H(nt+k-1,0,0) then Q 5X1 (QXo- + BH F(x,)) is equivalent 
2 = 
to (Q%4 M1) (QoX qo QB FC). 
Now for each a€S such that ||al| <m,, consider the formula 


Q5%5 Q,%4 ws -Q F( 8sXosXq yore 2%,)+ Because & is H-bounded, if 


my 2H(ntk-2,1,m,) then Xo (Q5%30 + QF Ca, XyXqa-0e o%,)) is equivalent 


to (Qo <m,) (Q,%5- ae WX, F( A,XosXqoree 2X) ). Hence, 
(Q,%, <m,)Q.x,- 7 OX, F( x,) is equivalent to 
CQ, Sm) (QyH, Sy )QgXg 0+ BH PCR) « 
By k-2 additional applications of the R-boundedness of 8, we arrive 


at Lemma 2.11. 0 


We now demonstrate the existence of a getieral method of proving 


H-boundedness. 


Lemma 2.12: Let H:N? +N be a function which is nondecreasing in each 
argument, and say that for each n,k€N we have an equivalence relation 
Eo on sk satisfying the following properties: 

1) For all kEN and all a5, €S*, ay, Ey b * a, 5 B. ‘ 
and 2) If n,k€N and a, ody és* such that a, we bys then for each 
Bey €S there is some bee if S such that ae E 5 and such that 


n k+l 
[Toy ll sank, Max, (| ei [}). 


THEN 


ot 


Sty Te 
I) For all n,k€N and a, 2b, €S » a & 


a! 
ill 
o 
Pa 
e 


and II) 8 is H-bounded. 


Fh 


Proof: 


of I) by induction gn n: I) certainly holds if n=0. Assume I) 
is true for n; we will prove it for n+l. 
Say that a. El b,3 we wish to show that ay nil Bee By Lemma 2.4 


and the symmetry of E it is sufficient to show that for every By, 41°58 


n+l? 
there is some by, €S such that aay - are So choose ay & S. By 2) 
there is some “i 1 Es such that ae] E, by. ay’ By the induct on hypothesis, 
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S41 Tt 

Proof of II): Let CD be a formula of q-depth <n and let a, € sk 

be such that: By, Py) is true. Leta) €s be such that F@ 
Roddes Since ay Eat ay condition .2) implies thet we can find some 

a ae S such that a, a & (a, 94441) and such that 

: ' ‘ ‘ : ' - - 

ae 2 (a, 941) = F(a, 54) 41) holds. ‘So 8 is’H=bounded. (. 


By applying Remark 2.9 to Lemma 2.12 we immediately obtain Lemma 2. 12°. 
Lemma 2.12': Say that for each n,k€N we have an equivalence relation EL 
on sk satisfying the following properties: 
1) For all k EN and all a, 2b, € er. a, Ey b => a, Fd by 
and 2) If. n,k EN and a, 2b, € sk such that ay ‘ot Bes then for each 
Ay €S there is some Diy 1°58 such that aa E - Bee 


THEN for all n,k€N and 3,5, 8° » & EB b 2 a = be 


We loosely define an "Ehrenfeucht game (abbreviated E-game) decision 
procedure" for TH(S$) to be one that involves defining relations EA and 
proving that the conditions of Lemma 2.12 or 2.12' hold. ‘This will be made 

‘clearer in the examples of Section 3 and Chapter 3. In Section 4 of this 
chapter we present a general discussion of the computational complexity 
of E-game decision procedures. 

Lemma 2.13 shows how H=-boundedness implies bounds on the norms 
of members of the = equivalence classes. 


Lemma 2.13: Let Hit? +N be such that 3 is H-bounded. Let n,k€N and 


let mm, En be a neence such phate, Stated tat eee i)? for 


Atte, et Poly Spee BEBE Se ot Eecitlen Nzs : 
De EMER ee SEE Se a eg Ry ed 
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oil} 
tan 


1Sis<k. Then for each a, € gk there is some b,. € gk such that a, 


and IIb. || sm, for 1sisk. 
i i 


Proof: Let n,k,m,, and ay be as in the statement of the lemma. By 


3] 


Lemma 2.6 there is a formula F(x,) of q-depth n which defines the 

equivalence class of ay. Since F(a) holds, x Baty. «Hx, FC X,) is true, 
fr < <4 ae 2 7 

So by Lemma 2.11, (Sx, m,) (dx, Sm)... (xy, Sm, DF Ca) is true. This 


means that for some b, € gt F(b,) is true and IIb, 1 sm, for Lsiek, 13 
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Section 3; An E-Game Decision Procedure for Integer Addition 


We now present some applications of Section 2. For the rest of 
this section let &| be the language of the first order predicate calculus 
with the formal predicates v,;+v, =v, and v,Sv,. and the constant 


symbol 0 (where Vy»Vo9V, represent formal variables). 


Definition 3.0: Let Z be the structure < Z, +, <, 0 > where Z is the set 
of inteaers and where + and < are the asial integer addition and order. 
If a € 2, define |} al | = Jal = absolute valde of a. | 

? We will obtain a theoretically efficient decision Srocedure for TH(Z) 
using results of the previous section. Although we will ‘be using an 
Ehrenfeucht game approach, many of the ‘ase we shall use come from a 
quantifier elimination decision procedure for TH(Z) obtained by Cooper 
[Coo72] and analyzed from a complexity viewpoint by Oppen [Opp73]. We 
choose this example because it illustrates our thesis that all known 
quantifier elimination procedures can be éonueetad to ewes denibiton 
procedures without significant loss of time and. sometimes with a saving 
of space. Some of our results about TH(Z) appeared in preliminary form 
in Ferrante and Rackoff [FR74]. 

Although our procedure for TH(Z) has about the same time complexity 

as Cooper's, it only requires a logarithm of the space used’ by Cooper's 


procedure. 


Definition 3.1: If a, b, c € Z, then ar b mod c.(a is equivalent to 
b mod c) if c divides a - b. If A is a nonempty finite set of integers, © 


then lem A = the least positive integer which every non-zero element of 
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+ 
A divides. 
Definition 3.2: Let a, b € Z and let d € N*. Then we write a = b 

; ae . ae 
if either “yy a=b 

2) a2d and b2d 

or 3) a S -d and b < -d. 
When we talk about = holding between objects one of which is the 
| | 


cardinality of a set, we will often omit the vertical lines indicating 


cardinality. For instance, if A and B are sets, we will write A = B 


d 
and A = 5 instead of [A| = |B| and |al = 5. 
d d d 
Lemma 3.3: Let a, b€ Z and let d ENT. Then a - be 
for every c, -d<ec<d, a2e ae zc. 
Proof: Left to the reader. ol 


Definition 3.4: Define a sequence of sets of integers Yo Vor vy,» V. Vioee- 


as follows: Vo = {-2, -1, 0, 1, 2}. If vy, has been defined, define 


1; &.v' 2 ¢ ' Fs 
‘= { = | 8 = lem V3 v, v'€é V3 v #0} and define 
= ' 
Vier 7 Ville +b | a, be vip. 


Definition 3.5: Let n, k € N. Then define the equivalence relation 


E_ on zk as follows: Let a b, € 2 let 6 = lem V_. 
n k n 


We use this nonstandard notation for equivalence mod c so as not to cause 
conflict with other notation we use. 
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Then a, En by, iff for every Vie € qwyk: 


k k 5 
1) &.ov,a, » DUv.b, mod 6 
i=l ivi ier * i 
ok k 
and 2) Z0v,a,= 2 v,b 
eke er ea 


Lemma 3.6: Let k € N and let ay b, é€ z* such that a, Ey b,- 


Proof: Say that a Ey by. We wish to show that for any quanti fier 
free formula F(x,), Z+ F(a,) eZ + F(b,). Since every quantifier 
free formula is a boolean combination of prewic Esrasias: it is 
sufficient to assume F is atomic. We teed. only consider the following 
cases for F: | 


+ xX, = 


x, = Xi. x sx +x, =x 2 = Xp x + Ky = Xp. Xy + X_ = Xq- 


1 1 2? *4 1 yy * 


In these cases, in order to show that ZF F(a,) eZr F(b), it is 
necessary to show (respectively) that 05 0°0< 0, 


a, 7 ay sQ°¢ b, -b, 50, a, = 0b, =0, ay = 0° b, = 0, 


1 2 1 1 2 


2a, 7 a) = 0° 2b, - by = 0, a a) 7 ag = 0° by + by : b, = 0. 


But since 0, eae 2, € Vo? all these facts follow from 2) in the 


definition of E,. | a OD 


cn 
25 
Lemma 3.7: For some constant c, lv. | Ss 2 and v. = {-a | a € vi 
oo 
and Max ve <2 for all nE€N. 
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Proof: vl = 5, In general, lvl s kw, |? and 


Iv Ilv,| + Iv? < iv, so |v_| s 5°, 


in! * 


It is trivial to show that V_ = (-a ls ev). 


Max V, = 2. In general, lem V, < ata So 


0 


Max V S Max (Max Vie 2+Max vy) < Zelem V,°Max V, 


£ L 4 ny 
35, gO a st AY 
< 2+ (Max V,) Max V, < (Max V;) e So Max VS 2 “ 
yen a 
|v,[s 2° and Max vi < 2 


i+1 


for some constant c and all n € N. | 


Theorem 3.8: There exists a constant d such that che following im true: 


Lat m, ke Band tet ,, B, cH much emt Fatt Fk Then for each 


aet E€ 2 there exists gome Beet | € Zz such that Bea? Fa Bee ed euch: ‘that 


a(t) 


lb | $ (1+ Max [b,}).2% ‘ 
Bleed neige 


Proof: afte Ey, and that a, € let 6 = tem Vi wad 


note that 6” = lem Vv! since 1 € V,. Let os (Eye: +v fv, 60. 
| i=] => e 


for 15 i =k and Jol < 63) be a nonempty subset of 7. There must 


exist either a member of T which is =< ba or a neabae of Tz ba. 


(or both); these two cases are symmetrical, so ageume without loss of 
generality that some member of T is < $6a,,. Let Zvia, + v be the 
me ing * * 


largest member of T which is s Say where v5 é v! for 1si < k and 


{vj s 87. Consider the sequence 
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k k k | ic an 
Uvia, tv, ova,tv+i, Zvia, +v + 2,..., Dvja, tv ts 2 
i=l i=l i=l i=1 


Tf Say is not equal to any of aaa Na bay is bigger than all 


of them and one of them (other than 2 Via, + v) is equivalent to 
i=l | 


Sau mod coe It is therefore the case that for some u; |u| < 6° 


k k 
3 

and au v,a, tv +unp ba, mod 6) and z va, tvs 

i=1 ; i=1 
k k 

s 6 = - = 
x va, t+vtu bay and u = 0 x v,a, + Vv baat 
i=1 i=] 
k 

: < ° 
Claim: For every t € T, t Fated t+vtuets Say and 

k 

2 

t2 Uva tvtuee Sai 

i=1 
Proof of Claim: If peat tutus bay? then the claim is trivial. 

ko | k 
So assume a Va, +vtu# Sa: Then u # 0, and so Z V534 +vtu is 
i=l i=1 
k | k 

strictly between pra te! + v and bade Since 21494 + vis the largest 


member of T s Sap we cannot have any t € T such ‘that 


k 


Uva 


2 174 +vtusts ba hence the Claim follows. 


= 4 ! ‘ + '¢ 
Now let y = lcm Viti’ Since O€ Vv O€ Vn’ Therefore ae Vial? 
Since 5 = lem Vi and Viel m (ele € vi >» we have 28° divides y. Since 
aE aK: eee RS ras v,b, mod y , and so baa aS 
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k k | , 
Divya, tvtuw Z vib; +v tw mod 6 
i=] i=1 

k 


implying that § divides © v,b, +v+u. Define 
| i=l 
k 
b = Satis +v+tu)/6. We will show that Nett Ft 


2 ee “etl kt 
Let w, € wy : We want ta show that uw,a, =e Dwib mod 6 
tet1 ? att qezx 2 1 


2 


k+l le+1 
and that oa t a oe TE Way = 0, then these facts follow 
) 


immediately from the fact that aE me since VS Vi.) and 67 divides 


2 
y. So assume 1 we # 0. 


k k 
2 | . 
Since a be we have ries Rs certs mod. 5", Thus to. show 
k+1 k+l | 
that 2 W,2, * x ig i ag mod 67 , it is sufficient to show that 
i=l] i=]. j 


2 2 
Met ett Meet Piety Bd Os BUE Ma Seer © Met Per BOP Oo 


2 etl ke+1 
co) bans Pe bby ea mod (5 /w 508 ). Hence are fs at mod 62 
k+1 
Next we will, show that Bm F ee > yes Since vy = («ala € Vy ; 
k+l kel Ket k+l 
and since Z w,a,. = Zw, b, oo “W, 8, x we “bys Wwe can assume without 


gay tt 5? guy F del (Oe 


loss of generality that w. > 0. By Lemma 3.3 it ts suffictent to show 


ke+1 
k+1 k+1 
that i w,a; 2da0 Zw,b, for every d, fal s 87. “Therefore fix d, 
i=1 i=l 


al 8°87. 


ke+1 k 
Pet! 240 Fateh ss ar tt + bay z d(8/w i) ° 
k 


ba, 2 (2 “8 iH, ay) + (B/D. 
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(-b/w_,,)¥, Vi for 15 isk and |d(S/y,,)1-5 eee 


k+1 


k 
( na (-6 /w ett a. ) + d(5/w. et € T. By the above Claim, we can 


continue: bay (2 Oot d(8/w 47) ° 


k k 
DUv.a, tvtu2z( O(-6/w )w,a a + 46/0 
i=l] 


k+1 kt * 


yw, a, = d(6 /w -ve- wu, 


kt+1 ) 


k 
Fate (vy + G/L 


3 


|d(S/w...) -v-ul| s 36> s wr (since 25° divides y). 


Vict] 


Because aE nt we have 
k 


= (v, + (5 Ja wy) ay z d(6/w. ee) -veu? 
i=1 


k 
xu (vy + (5/w be 4) Og = d(6 fw “icy By Sb-2 


i=1 
k k 
x (8 Fi ¥ 4b, b, + Dv yo, tv tue 4(6 Mes) ° 
i=l i=1 
k k+1 

2 2d, 
Pass tear + bby a(S /w 4) ° Pd d 


It remains to calculate the size of nl 7 


“Max (b,) +5" + 8° 


1sisk 


[<1 2v,5, +v+tul < keMaxV 


|b es] nt+1. 


S k-Max V *Max (b,} + 2- (Max V. Mal 3, Therefore by Lemma 3.7, 
n+1 i 
lsisk ‘ i 
_9d (nt) 
we have for some constant d, |b, | < (1 + Max (b;})2? oF 
+1 1<i<k 1 
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Corollary 3.9: For. some constant d, Z is H-bounded where 


24 (atk) 
H(n,k,m) = (1 +m)2 


Proof: Immediate from Lemmas 2.12, 3.6 and Theorem 3.8. CJ 


Theorem 3.10: Let F be the sentence of £, 04% Qp%p- + WRECK) where 


G is quantifier free. Then for some constant d independent of n, F 


gdntl gdnt2 i gatrin 


ae 2 2 aS 
is equivalent in Z to (Q,%, < 2 )(Qox, <2 rr (., < 2°. )G(x_). 


| | jie) 
Proof: Say that Z is H-bounded where H(n,k,m) = (1 + m)2 ‘ 


odnti . 
Let m, = 2? for 15 isn. Applying Lemma 2,11 to Z, we see that 


since m, 2 H(n = i, 1 = 1, Max {|m,|}) for 1< i<n, F is equivalent 
: isji_ J 


to (Q,%, < m,) (Q,x, <m) .. (Qx Sm) 6 (x). = 


Corollary 3,11: For some constant c, TH(< Z, +, <, 0 >) can be 


decided within space 2” . 


Proof: By Theorem 1.4.2, given a sentence F of i, convert it to an 


equivalent sentence Qy*12%, rr On G (x) where G is quantifier free 


hla 


and of length at most n log n where n= |F|. F is equivalent in Z to 


dnt1 gdnt2 dnin - 


2 2 2? = 
) sass (x, “2° " 96 (x,) for 


2 
(Q4%4 <2 )(Q,x, < 2 
some constant d (by Theorem 3.10). 
F can be decided in Z by setting aside for quantifier Qi» lsis<n, 


oan ganti 


2 + 2 tape squares; every integer < 2” in apaciare value 
can be written in this space in binwey: Then decide F by cycling - 
through each quantifier space appropriately, all the time Prin 
the truth of G on different n-tuples of integers. We let the reader 
convince himself that a Turing machine implementing this outlined 


cn 
procedure need use only 2? tape squares for some constant c. C) 


Theorem 3,12: For some constant c', any nondeterministic Turing 
cn 
machine which recognizes TH(Z, +, <, 0) requires time 2? on 


some sentence of length n, for infinitely many n € N. 


See Fischer and Rabin [FiR74] for a proof of Theorem 3.12. Their 
proof uses the method described in Chapter 1, and hence, for the 
reasons described in Chapter 1, the upper bound of Corollary 3.11 matches 


the lower bound of Theorem 3.12 reasonably well. 


Definition: Let R be the structure <R, +, <, 0© where R is the set of 
real numbers and + and =< are the usual real addition and order. 
As above, the upper bound for TH(R) in Theorem 3.13 is close to 


the lower bound of Theorem 3.14, 


~&2~ 
Theorem 3.13: For some constant c, TH(R) can be decided in space 7 Mac 


The. proof appears in Ferrante and Rackoff [FR74}.. Although part of 
their proof uses quantifier elimination, it could be rewritten to follow » 


the E-game format used above without loss of efficiency. 


Theorem 3.14: For some constant c', ay nondeterministic Turing machine 
which recognizes TH(R) requires time 3° * on some sentence of length n, 


for infinitely may n. 


See Fiecher and Rabin [FiR74] for a proof of Theorem 3.14. 
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Section 4: Complexity of E-Game Decision Procedures. 


We have mentioned that an E-game procedure for deciding TH(S) is 
one which proceeds by defining relations E, and proving that the 
conditions of Lemma 2.12 or 2.12' hold. It is then necessary, in 
order to decide a sentence with n quantifiers, tobe able to write 
down for every i between 0 and n representations of all the Ey 
equivalence classes on gvi, this ie what is really going on in 
Lemma 2.11 and the examples of the previous section... Chapters 3 and 4 
contain further applications of these ideas. 

It is not enough only to be able to write down for every n, k €N 
representations of all the Ez, equivaience classes on s¥*, -but this is. 
certainly a-necessary part of an E-game decision procedure, Recalling 


that the z classes are at least as ‘numerous as the = classes (because 


of Lemma 2.12), we see that if a R-game ‘procedure (as we have described 
them) is to be elementary recursive, it is necessary that M(n,k) be 
bounded above by an elementary rectrsive function. 

Now the only other method we know about for obtaining elementary 
recursive decision procedures is elimination of quantifiers, and we have 
stated above that in all known cases a quantifier elimination procedure 
can be transformed into an E-game procedure without sacrificing (if it was 
there in the first place) elementary recursiveness. What this means is 
that in order for a logical theory to be elementary recursively decidable 
by known methods, it is necessary for M(n,k) to be bounded above by an 
elementary recursive function. This raises the following important - 


conjecture. 
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Conjecture 4,1: If TA(3) has an elementary recursive decision 
procedure, then M(n,k) is bounded above by en elementary recursive 


function. 


Although Conjecture 4.1 is open, its converse is definitely false. 


For the purpose of this coumterexample, let £ be the language of 
the first order predicate calcelus with the foraeal predicates My ™ Vy 
and Vi ~ Vy , is equivalent to Vy) and the constant aymbel 0 (although 
the constant ‘symbol ign't really necessery). - 

For every nonempty set A of positive integers let X be an. 
equivalence relation on N such that for every: positive integer i 

1) if 1 € A then there is exactly aaa equivalence class of size i. 
and 


2) if i@A then there are no equivalence classes of size i. 


Define the structure 8, =<N, =, ro 0 >. 


For any i € n*, there is a sentence Fy which can be obtathed in 
time polynomial in i which says that there is an equivalence class of 
size exactly re Therefore, if TH(8,) can be decided within time g(n), 
then A can be decided within time g(p(n)) + P(n) for some polynomial p. 
Since we can make A arbitrarily hard to decide or arbitrariity nontecursive, 


we can make TH(8,) arbitrarily hard to deéide or arbitrarily notirecursive. 


Now let A be a fixed set of positive integers and consider M(n,k) 


oes 
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for $43 we will show that (no matter what A is) M(n,k) is bounded above 
by an elementary recursive function, contradicting the converse of 


Conjecture 4.1. 


For each a,, by € né define os EA by, iff for all i,j such that 


1 Ssi,j < k, 


T) ct ee a is ee and a, =0¢b, = 0. 


II) a.~ a, ®@b, ~ bd 
») 44 34 ins 


and 


III) {a EN | aya,} = {bEN | b+ b,}. It is not difficult to prove 
ae eee K 


2 


Lemma 4.2 using Lemma 2,12'. 


Lemma 4.2: a, Eb, > a © by. 


Since the number of FE, equivalence classes on n* 


is bounded above by an elementary recursive function (of n and k), 


ec (mH) 


f >» M(n,k) for $s, is bounded above by the same function. 


namely 2 
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Chapter 3: ak Direct Powers 


Section 1: Weak Direct Powers and Ehrenfeucht Games 


Let £ be a language of the first order predicate calculus with a 
finite number of predicate symbols > Roreees Rr, such that &, is-at, 


place formal predicate for 1 =< i < L, and with a constant symbol e. 
Definition 1,1; Let 8 =< S, R,> Royoees Ris e > be a structure for £. 
For all a € §&, Tal | is the norm of a. ‘The weak direct power of 3 


is the structure B* -< s*, Ri ee Ris e > where 


s* = {£: N48 | £(1) #e for only finitely many 4 € N}; 


: : 
for 1< js 4, if 4, es 4, then 4, € a, Aft #0 ER, for all 


1 €N (where z (1) abbreviates (£, (1), fGyice. £. (4) 5 
j j 


e (1) =e for all 1 EN, 

For a norm on 8 we define, for f € s*, 
[le|| =mMaxqi en | £4) #e} UC[le|| [2 em). By £ <mwe will 
mean ||£|| < m. 

Mostowski [Mos52] and Feferman and Vaught [FV59] both show that 
TH(S) decidable = TH(8') decidable. However, their proofs are such that 
in every case, the decision procedure for TH(S*) obtained is not elementary 
recursive, In this section we will present some general theorems which 


will allow us to derive significantly more efficient decision procedures for 
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TH(S*) in many cases, and in particular to obtain a procedure for TH(Z*) 
(where Z is the structure of integer addiction defined in Chapter 2) 
which closely matches the known lower bound. In ‘Chapter 4 we prove 
even more general theorems which give a condition under which we can | 
conclude TH(3") elementary recursive if TH(S) is elementary recursive. 
Now let H: w +N be such that 3 is H-bounded. : Let M(n,k) be the 


function as defined for S in Chapter 2, definition 2.2,5. 


Definition 1.2: Define the function u: n? +N by setting (0,k) = 1 
Se an o 


and p(n + 1, k) = M(n, k + 1)eu(n, k + 1). Hence p(n,k) = IT M(m - i, k + 1). 
i=1 


Definition 1.3: Define i’: w +N by H’(n,k,m) = 


Max (H(n,k,m),m + y(n + 1, k), [lel |}. 


‘ : * 4 
' The major theorem of this section will show that 3 is H’ -bounded. 


We now prove a combinatorial lemma. = is defined in Definition 2.3.2. 


Lemma 1.4: Let Ny and N, be sets and let n, m Ent such that 


Noe Let Ay» Agseees AL be a sequence of (possibly empty) pairwise 


Ny nem 
n 
disjoint subsets of N, such that U A, = N,. 
i=l 


Then there exists a sequence By» Boseces BL of pairwise disjoint 


. n 
such that UB, = N 


i=1 i 2 


subsets of N and such that A,.= B, for ls is n. 
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Proof: If Ix, | = Ixy] then the Lemma is obviows. Assume IN | = nem 


“and In, 2nem, For some i, 1 <i <n, we must have o Ia, b =a so assune 


without loss. of generality that lA, | 2m 


- Define cobble, Paseees Py € N by. 


|A,| t£ [ay] <m | 
Py . for 25 isn, 
.m if la, | =m Z 


Clearly £ Py < (n -1)m=n-m-m, Since In, | 2n-m, there exists a~ 
sequence of pairwise disjoint subsets of Nos namely Bos Bascees Bae 


such that |B, | = py for2<i<n. SoA, 5B, for 2Sisay ter 
n : n : : . 
i Ny - U Bie ly, 2 nem and U B, Snem-= m, so ls, I 2m. Since 
i=2 i=2 | . 
|a,| =m, A, = By. ra Ge . 0 


For every n, k € N, define the Ehrenfeucht relation = on both 


in 


4 
sk and (S as in Chapter 2, Definition 2.2.1. 


Definition 1.5: Let n, k € N and f,, a. ecs*)¥, Then we Bay fa E, 8 


Bil 
+ 
a 


iff for all a, € s* »( en] 2) =a fe En | zZ(4) 
Hin, 


Lemma 1.6: For all kEN, £, g, € (Ss )*, a F E, &, then £, 


Onl 
e 
° 
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Proof: Say that a Eo By We wish to show that for every quantifier 


free formula F(x), 3* F F(£,) ° 3* Fk F(g,)- It is clearly sufficient 


to prove this for the case where F is atomic. By symmetry, it is 


sufficient to show that F(E,) false in 8” = F(g,) false in 3. 


Thus assume that F(£,) is false in 3". By definition of the 


* = 
relations of 3 we can choose iy € N such that F(£, (19) is false in 8. 


Since f, E,) 8, we have that (i €N | £ (4) = Fy (49)} = 


“u(0,k) 


{i en | 8, (4) = £.(ig)}- Since u(0, k) = 1, we have 


(1 EN | &, (4) = = (io) 21. So let i, €N be such that 


&, (44) = £,(15)- By definition of &, F(£,(4p)) false in 


8 = F(g,(1,)) false in 8. So F(g,) is false in 3", 


Lemma 1.7: Let n, k EN and £,, Sy, € cs*)* such that £ Et 


* * 
for each fat € S there exists some Stet] € S$ such that 


and 


B° 


Then 
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Proof: Let #, 6, € (s*)™ be such that EBay g,. Let 


pace enrer ed 


: * = _ (n. 1) 
m = Max (19,113 ad tet §., 6 8. tate, Be ese, Em BHD 


be a sequence of representatives of all the = equivalence classes on 


kt+1 . * 
Ss". Our goal te to find Suet €S euch that if 1 < j = M(n, k+l), then 


Gen lf, met = teen | gyn 2B we also want 
y(n, ktl) 


\g,4,!| < H'(n,k,m), ‘Instead of defining g,,, simultaneously on all of X, 


we will define it separately on various pieces of N. 


For each a, e sk define Ny (a) = (LEN | £,(4) = al. and 
z ; oer 


No(a,) ={i1EN| g, (4) ia a) We claim it ie sufficient to define 


Bicty OD each No (a) such that 


1) (LEN (a) | Hs Ret) aa) (2 €noCa) | aC) = bE) 


for all j, 1 < j = M(u,ktl). 


Il) If i € No (a,) and i >m+yu(n+1,k), then g.ii(4) =e. 
and . 


III) If4 EN, (a) md ism+u(n + 1,k), then [lel s H(n,k,m). 


An examination of the definitions of H and the norm on 3* will show 


oe awe SE) yaa ratgy Poe eS Ske nea ca Boe ke tg! yeh ete ot - a me “ 
oT Sea ois ras ie as ara ;: Doe ag oc ut OW epee ee pt oe yy tr ata eee Set ee od ee 
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that II) and IIT) together imply | lenea! | < H (n,k,m). Since 
_ _ ee k . 
{Ny (ay) | a, € a) and (Ny (ay a, € S} are each a eal oF 
disjoint sets, it rc easy to see from I) and the definition of 
= that if 1545 MO, itl) then | , 


u(n, k+l) - 


(_U (em) | (4) = Bd }) ies CUS (ene y Ig. (a) =i ), 
2, e8* 104 | Ay DF Bay xen) se mG, Stl ict 


te., (1 EN | £, a) =) = Pee (4) 3 I 
| a a ea) ee 


“So now. let * < s* be fixed for the rest of this proof. Abbreviate. 
UN 1% by be and. 4 May) by Np. Begin by dating myil4): = ¢ if 

i € Wy and i > m * aad k)3 this guarantees II) above: Te. ‘remains to de- 
fine sig es = a € Ny | ismt+u(n+1, k)}... 


The definition of E tl implies ‘that N, = Ny We now 
| (ntl) 


ies demonstrate that. N, = ae = a then N is a infinite set, 
1 As! eo aa 9. 


and IN, | 2 p(n + 1,k) since g,, (4) = o for m< i smt w(n + 1,k)3 if 


a # chen Wy +H (since i > m+ y(n + 1, wade bor eny. 
ntl , | 


© w(t) ie 


_ ‘Define, for 1s j < M(n,ktl), A 77a en, | £40). = Wee 5 


Cee ce a cecaiiiaietins taa-anaadimiaumesteneetenaa.ciemeamnndieanenentinceameliarinmaeiramant - Sg 
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Ay» Agseses Aun, Jet) form a sequence ae pairwise disjoint sets wens 


“union is N,. ‘Since N, = ON, and fn + 1,k) = M(njk + lun, k + 1), 
eon u(t, k) Weg ee ee 


Lemma 1.4 tells us there exists a sequence By» Boveces Bu(n, tL) of” 


pairwise dis joint subsets of N, whose union is Ny euch that 


A, = B if£.1< $< Mn,k + 1). 
J ume) 4 


Now let i € Nj; we want to define €.45 oni. Let } bea ere | 
i€é Bye Since B, #¢, we aleo have Ay #¢. So let 15 € A,- Since 


15 EN and i €N,, we have £ (i, uae = eS i en Dy amma 2.2.10 


1 


we can define g,,,(4) such that ty) 7 Say CL) and 


He lls ses gamle ue ela Ie, (4) 113) < H(n km). 


i 
Clearly III) above holds. Since ip € Ay? fiyy(ty) = ss baa? So 


Bip (1) . Bocas Thus, we have defined By € s* rf) that for 
1s 3 < M(n,k+), 


(1 EN, | Bog (1) cae “3, = A. = a En, | Fea & e Ba i 


w(ng ket) J 


sii 


‘To complete the proof of Lemma 1.7, we must show I), i.e., 


{i en, | g (1) 5b } eis Pe Mee FD: 
No | Sy i a(n, eH) as 
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So fix j, ls 4 <M(n, k+1). If 
{i € No | Bee (2) = bh = {1 € N, | Be oh) = b)) we are done, so assume 


(i EN, | 8,04) at # (1 EN, | Bip 1) 


sil 


5d 
Pica) * Since 
Ny = (1 € Ny | 1s m+y(n+1, k)), there must exist some i >m+u(n + 1, k) 


such that i € No (hence a(t) © a) and Bry CL) be cae “But since 


i>m+p(n +1, k) implies Bia) = an, this means that a, ay ae 


k+1 


and By e . Hence, both A, and {i € No | Sa =b) are 


Silt 


infinite, so (1 €N, | g,,,(1) = be.) = Age 
? i cee aes ss Lae eer ee 


* * 
Theorem 1.8: 8 is H -bounded. Also, for. every n, k € N and 


_ oe *k = <= mas won 
f.2 8 ©), f EL a 7 A 8 Se 


Sill 


Proof: This follows immediately from Lemmas 2.2.12, 1.6, and 1.7. ma 


We now present some applications of the material-in Section 1. 


Let &, ‘be the language of Chapter 2. 
Let Z =< Z, +, <,°0 > be'the structure of Chapter 2 and let 


r = <2", +, 5S, 0" >be the weak dtrect power of Z. As before, for ~ 


a €Z let |lal| = fal end, following Definition 1.1, for fez let 


[|e|| = Max (4 EN | £(4)-# 0) U Clee] [a Emp. 


pe (irk) 
*e 
Lemma 2.1: There exists a constant e such that Z ts (1+ m)+2° -bounded. 
94 (tk) 


Proof: By Corollary 2.3.9, Z is H=bounded where H(n,k,m) = (1+ m)+2” 


for some constant ‘d. We-new calculate bounds for the function M(n,k) for Z. 
gd (tk) +i ; 
Letting m, = 2? for 1 <‘i <'k, ‘we see ‘that 


m 


_2H(n +k + 4, i+ 1, Max (|m,|})-for 1 < 4< k. 80 by Lemma 2.2.13, 
isjsi J 


for each a € 2k ‘there is some,-by. €E ia such that om a b, rand 


A for 1 < i <°k. ‘Hence, since m, s m,,» we eertainly have 


|b, | <m 
gf (tk) Hk . 


M(n,k) < (227 + 1)*, So u(n,k) = I M(m - i, k +1) s 2? 
i=] ey 


of! (ntk) | 


for some constant d'. 


So for some constant 'e, H’ (nj; k,m) = MaxfH(n,k,m), m+ u(n +1, k), 0) S 
oe (tk) 
(1 + m)-2? 


25 5= 
&- (ntk) 
a * 2 
By Theorem 1.8, Z is (1 + m)*2 -bounded. 0 


Theorem 2,2: Let F be the sentence of £,, Q1*4AXo wee Wane Oy? where G 


is quantifier free. Then for some constant e independent of n, F is 

gentl gont2 genin 
equivalent i z* to (Q,x, 2? “4(Q x, 8 27 ) (Qx 2? )G (x ) 
ae a "1 2*2 ee nn NA 


. Proof: Theorem 2.2 follows from Lemma 2.1 exactly as Theorem 2.3.10 


follows from Corollary 2,3.9. . « 


_ 4. = 
Corollary 2.3: For some constant c, TH(< Z, +, <, 0 > ) can be decided 
gen 


within space 2? ; 


Proof: By Theorem 1.4.2 it is sufficient to consider the sentence F of 


£, which in prenex normal form is Q1%4o%o 2+ Ox G(x) where © is 
quantifier free and of length at most n log n. 


By Theorem 2.2, F is equivalent to 


gent] Pie 


| jentn 
(Qqx, < 2° M(Qp%y <2) wee QR, <2 


; G(x.) for some . 


constant. e. ent. enti. 


; 2 a ; 
te hee - we gs 
Now if f£€Z and f < 97: then f(j) = 0 for j > 27 cand: 
genti | | 


enti. 
Jecyy| s 27 °° for all 4 €N, so the £irat.27* 


_ successive values 


92 


Paice 


ent 92 


ve 2)02 


of f can be represented on a tape with roughly (2 
tape squares. So a procedure like the one outlined in Corollary 2.3.11. — 
would decide TH(Z.} in space 2 for some constant c. . Els 
Rabe * * *. 

Definition 2,4: Let N be the structure<N, +, <5, 0 >, i.e, the 

weak direct power of the nonnegative integers (under + and <)._ 

Remark 2.5: The structure <N , +> is isomorphic: to the structure 


+ 


<N, ° > (i.e., the positive integers under multiplication). So an — 


upper bound on the complexity of TH(N") ig an upper bound on TH( < nt, * >). 


gon 


* 
Corollary 2.6: TH(N ) can be decided in space 2? for some constant c. 


Proof: Since x 2 0 tsa a formila of £, it is easy to see that: 


TH(N’) SO TH(Z*). So Corollary 2.6 follows from Lemna 1.3.2. ~ el 


The upper beund of Corollary’2.3 and Corollary 2.6 


‘matches the lower bound of Theorem 2.7 reasonably well. 


Theorem 2.7: (Fischer and Rabin [FiR74]) For some constant c' > 0, any 


nondeterministic Turing machine which recognizes TH(Z") (or TH(N’)) 
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requires time 2? on some sentence of length n, for infinitely many n. 


Our next goal is to present a decision procedure for the first order 
theory of finite abelian stadpe: | this theory was originally shown to be 
decidable (see [Szm55], [ELTT65])by a less efficient procedure than ours. 


. 
Our approach will be to show that this theory is = 4 TH(N ) and conclude 


Theorem 2,8: The first order theory of finite abelian groups can be. 
gen . 


decided within. space 2? for some constant c. 


There is still a significant gap between the upper bound of Theorem 
2.8 and the known lower bound of Theorem 2.9, 
Theorem 2.9. (Fischer and Rabin [FiR74]): For some constant c' > 0, 
any nondeterministic Turing machine which recognizes the theory of 


e'n ; rate 
on some sentence of length n, 


finite abelian groups requires time 2? 
for infinitely many n. 
The language of groups, £,, merely contains the formal predicate 


vy, + Vy = Vae We are interested in deciding which sentences. of £, are 


true of every finite abelian group. Recall that every finite abelian 


T this topic is also discussed in Chapter 4 from a slightly different 
viewpoint. - , : 
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group - (heacetorth abbreviated FAC) is isomorphic to a finite direct 
product of finite eyclic groups [MB68]. For i a positive integer, 

“let Z denote the cyclic group (Oy. Ly iaeds “ts 1} where addition is. 
performed mod 14 The basic idea of the eubetding (due to Michael. qT; 


Fischer (F1973}) is to think of every nonzero f : Nn" as representing 


an . FAG, Gee this is made precise in the following definition. 


Definition 2.10: Let £ € ws £¥¢0. Define ty = Mea EN a £(4) # a). 
Define Me! (Li 2yieve ® ) ~N by 
m3) = the j*> smallest member of (1 €N.| £(1) #0) for 1 <3 < te. 


where G,. = Z 


Define the FAG G, = G,xG,x ... XG ' §° “£(m_(4)) 


t for 1 <j < 4. 


% ’ os : oe ** * 
Clearly every FAG is isomorphic to G, for some f CN, f #0. 


x“ : 
Definition 2,11: Let f, g€N , £ #0 , be such that for all i €'N 


a) f(i) = 0 > g(i) = 0 
and 


b) f(4) > 0 70 =< g(1) < £(41). 
Then we say that ¢ represents <g(m,(1)), g(mp(2)), ---» g(mp(4,)) > € Gy. 


Clearly for each f ¢ Oo”, every member of Ge is sepresented by. a unique g € Nn’. 


We now describe some properties definable. in F, ‘by formulas 


* 
interpreted over N , 
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1) ONE(x). For £ €N", ONE(£) will hold iff for some 
i €N, £(i) = 1 and for every j # i, £(j) = 0. ONE(x) is equivalent to 
x # 0A Yx"((O'S x! A x! Sx) 4 (x! = O'V x! = x)). 


* 
2) ZERO(X, +X»). For f f, EN, ZERO(f, £5) will hold iff 


1’ 
ONE(£,) and £, (4) =Q > £,(1) = 0. ZERO(X, »X,) is equivalent to 
ONE(x,) A Vx! ((ONE(x') A x! # x,) 4 ~(x' < x,)). 
* 

3) PICK(X, »X5s%q)- For £,>f,.f, EN , PIPESE toe) Soe hold 
iff ONE(F, ) and 

(£, (4) _ 0 = £,(1) = O)A(E, (4) = 1> £,(4) = £,(1)) « 
PICK(x, »%5»%3) is equivalent to 

ZERO(X, »X5) A X, Ss Xy A ~(Xy + Xo Ss Xq)+ 

* * 

4) MEM(x,,%)- For f,,f, €N , MEM(f,,f,) will hold iff £, # 0 
and f, represents a member of Ge e MEM(x, , x4) is equivalent to 


1 


2 = % A VxVx 5 


* 
xy #0Ax Vx) ( [PICK (x,x, , x, ) A PICK(x,x),%p) | > 
(xt #04 x! ¢ x!) 
1 2 1°" 
* 
5) PLUS (x, »%52%q0Xz,)+ For f,,f,,f3,£, EN, PLUS (f£,,£5,£4,£,) will 


hold iff f, # 0” and f,.£5,£, represent members of G, and the member 
a iy 1 
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_ represented by f, ia the sum inG, of the members represented by f, 


fy 
and f4- PLUS (xy »%99%30%,) is equivalent to 
MEM(x, »X») A MEM(x, ,X,) A MEM(x, ,x, ) A Van Vax5 V3 Vx) [ 


(PICK (x5) 54) A PICK(x,x,,%») A PICK(x,%5,%,) A PICK(x, x, »X,)) > 


(x! + xt =x! Vxi+xt = x! 


si 
2+ %4 = %, Ve, + xy ~ x, + *))- 


Proof of Theorem 2.8: Using formulas defining MEM ite PLUS and the fact that 
£E x represents a FAG if asd only if f # 0”, se: obtade a procedure which 
operates in polynomial time and linear space which takes a: sentence F of 

£, to a sentence F' of £,, such that F is true of every 


FAG @ F' € TH(N’). So TH(FAS) Sot TH(N’). Theorem 2.8 therefore follows 


from Corollary 2.6 and Lenma 1.3.2.. a) 


Oo Sy Nepean 


Section 1: Introduction. 


Let &, 8, and 3* be defined as in Chapters 2 and 3, and let M(n,k) 
be defined for 8 as in Definition 1.2.5. 

Theorem 1.1: Tf. TH(S) is elementary recursive and if M(n,k) ‘is bounded 
above by an elementary recursive function, then TH(S ) is elementary _ 


recursive, 


Theorem ‘1,1 can be proven by modifying eitherMostowski's ox Feferman and 
Vaught 's decision procedure for TH(S)* {[Mos52,FV59],, but we present a 
different approach in Section':2 and prove. there acaamntivacive version 
of Theorem 1.1. In Section 3 we present some simi lar’ results for other 
notions of direct products (besides weak direct powers). . 


The converse to Theorem 1.1 is false. 


 Coumterexample to the Converse to Theorem 4ils 
‘Let &£ be the language used in the counterexample. to Conjecture 2.4.1. 


For every nonempty set A & nt define 8, as in Chapter 2 to be 
<N, =, ~ 0 >. As in Chapter 2, by varying A we can make 8, arbitrarily 
hard to decide. Let A be a fixed set such that 1 ¢ A, i.e., there are no 


- equivalence classes of size l. 


Claim: 3, consists of an infinite collection of infinite equivalence classes. 
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Proof of Claim: Since 0 is not in an equivalence class of size 1, there 


exists some number, say 1, such that 1 in 0. Since A # g, there exists 


some finite * class, and hence at least: two x Classes. So there 


exists some number, say 2, such that it is not true that 2 7 0. 
; . 
Thinking of every member of N as an infinite sequence of members 
of N, we see that the strings 0,0,0,... ; 2,0,0,... 3 2,2,0,0.0. 3 ose 


bot a x. 
form an infinite set of pairwise inequivalent members of N. So 8, has . 


an infinite number of equivalence classes. 

Let y,0,0,... be any member of Nn’, where y is a finite sequence of 
members of N. The strings y,1,0,0;.-. 3 ¥,;1,1,0,0,..- 3 es. form an 
infinite set of elements equivalent to y,0,0,... . So each equivalence 


* 
class of 8, is infinite, proving the claim. a) 


From the above claim? it is not hard to.see that a sentence of £ 
i . 
with n quantifiers will be true in 8, iff it is true in a domain of 
size av consisting of exactly n equivalence clesses of. size n. Therefore, 


| TH(S,) can be decided in polynomial space, even though TH(S,) may be 


arbitrarily difficult to decide. 


t and Lemma 2.4.2. . 
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Section 2: Complexity of Weak Direct Powers. 


Our goal in this chapter is to prove Theorem 1.1; actually, we 
shall prove a quantitative version of Theorem 1.1, sich Selates the 
complexity of TH(S") to the complexity of TH(S) and. M(n,k) . 

To begin with, let § =< By Rogues Rs e > be a structure as before 
and let £.be the corresponding first order. language. $ and {£ are fixed 
for the rest of this chapter. Let = be. defined on:8* for each n, k EN 
as in Chapter 2, Definition 2.2.1. Let Ck be the set of equivalence 


classes determined by 


= on gk. and let M(n,k) = Ic | as before. For 
n n,k 


a € sk let fad, be the equivalence class of a determined by 3, 
By Lemma 2.2.6, for every a e sk there is a formula F(x,) defining 


[ali What we are now interested in is how much time is needed, as a 


function of n and k, to write down all such formulas. 


Remark: Here is the motivation behind what we will be seine: Using a 

decision procedure for TH(S) we will obtain (efficient) papcewmibactoss 

of the members of Ck’ This will allow us to use results of Chapter 3 . 
to obtain efficient representations of the 2 classes on cs"), We will 

then decide the truth of sentences in s* by limiting quantifiers to 


range over appropriate sets of these representations. 


Definition 2,1: We will define for every n, k €'N a collection of 
formulas, an such aca in every member Pe oe ‘exactly Ky oXoveres My. 


occur freely. Firstly, for every k € N define 


=6he 


= (F(x,) | F is an atomic forma} ; for every ws S.. | 


define F (x,) to be the formla (NF) ACA ~F); define 
-W 


0,k,W 
| | | re : 
Fo 7 (Fouw | Sh Seay --. Ta Fy yla)- 


Assuming x et B® been defined such thet in every member exactly 
¥ 


Xp oXqoeees My, Occur freely, we now define ntl, k For every Wo Ie etl 
a ee 
define F Fart, wp * to be the formula ca ey) A ¢ Tm) 
13, me 


Define Fon, ef? wk, w) [S;+ Gx ,Gx, ... Unk tl, sw » Clearly» 


exactly XyeXpreees x occur freely in each menber of ene 


Lemma 2.2: Let n,k € BH. Then 


tac s* | some member of 3 


n 4k defines A} = Chk’ parr every 


member of C ie defined by « unique mamber of F 


n,k n,k’ 


Proof: Lemma 2.2 follows immediately from the proof of Lemma 2.2.6. 0 


We next wish to calculate how long it takes ag a function of n and k 
for a Turing machine to write down the ise an k on its tape when 
implementing Definition 2.1. In order for a Turing machine to do this 
at all it is necessary that TH($) be decidable, so for the rest of this 


section assume that there is some decision procedure for TH(S) which 
7 


Every F € 2 k is considered to implicitly contain the annotation 
’ : ‘ 
*y9 %» e@eegy ™,° 
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operates within time T} (n). In order to simplify the calculations 


to follow, instead of working with the function T (n) we will use instead some non- 


decreasing function T,(n) 2 Max (Tj(n), 25. It will similarly 


make things simpler below if we define the function 
T(n) = Max({M(n - k, k) | O<Sk <n} U (nj). The reader may 


note that at many places in the calculations below we make gross over- 
estimates. This is because we are ultimately interested in the amount 
of nesting of exponentials in the comple of our dacigion . 
procedures, and our over-estimates do not affect this, whereas they do 
have the advantage of shortening the expressions we obtain. 

We first define L(n,k) to be the length of the longest forma of 


the form Fk,W 


To calculate L(0,k), note that -(as in the proof of Lemma 2.2.6) 


L 
ls, | = Z (k+ 1) *i (where 2, is a t,-place relation for 1 <i < £). 
i=l 


As k increases, the length of the longest member of S,. will increase since 


longer subscripts of formal variables will have to be written; however, 


for every k 2 0 the length of the longest member of ©. will be < c,° (k+1) for 
some constant c, independent of k. Everything of the form Fo kW looks 
like a concatenation of the members of Gs with some additional logical 
symbols, and is of length < twice the length of the concatenation of the 


members of S, ‘That is,. 


The is easy to see that 1, is nondecreasing. 


hr: ; & te. Co : : 
L(0,k) <2-c,- (kt1I~D (k + 1) f < (k + 2) ~ for some constant: c, independent 
i=1 ey 


of ke 


Everything of the form F looks like a concatenation of the 
; ntl, k,W 


members of a ke? with some additional symbols; for some constant cy 
- Ty aan : : ; iz 


they are each of length < c,°(k + 1)«the length of the concatenation 


of the members of Fe That is, 
x . 


k+1° 


L(n +1, k) < cg*(k + 1)-L(m, k + 1°15 ea! < 


c4*(k + 1)-L(n, k + 1)-T,(n +k+1). Since 


c 
L(0,k) = (k + 2) 2 and Ty(n +k) 2n + k we can calculate that. 


; c, (atl) 
L(n,k) <(Max(T, (a-He) , 2} ) "> for every n,k € N and for some constant Cy 


Now define T(n,k) to be the time which a Turing machine implementing 


Definition 2.1 takes to write down F , on its tape. We first calculate 


ok 


an upper bound on T(n + 1, k) in terms of T(n, k +1). 
To compute FL, k we begin By competing on ktl wttts time T(n,ktl). 


| Z , 
We next ures down beside eas on the tape the set {F ntl, k,W | w Fake) : 


ket 1 
Then for eachW °F .., we write down the.eenkenee at 
. n,tetl 
Ex,Gx, 20 ux, F ntl, k,W? and then: ‘use our decision procedure for 
TH(S) to decide for sien W . Fa lett - St ae ts): coe Oxy Fetl,k,W" 


We lastly consolidate all the material on the tape (dee. erasing F_ for 
ome Me Fel, kW 


a672 
cases where it is not true that S F x, Ax, vee Hy Fad kW 80 


that next to Fy ket we have written Fitlk’ 


For each W & Fo LD we know that X1oXoo sees X, Occur in 


»k+ 


Fatl,k,w? 8° that |Gx,Gx, ... Gx, F < 3.| | < 3-L(n + 1, k). 


ntl k,W! Fotl,k,W 


The decision procedure for TH(S) decides whether or not 

St Bxjdx, ... Oxy Figs oy Within time and space T,(3-L(m+1,k)); 
actually in order to decide if Gx, Ex, oe ax, Fitl,k,W € TH(S) and 
return the Turing machine head (which started on the leftmost 4) to 
its original position requires time < 27, (3-L(n + 1, k)). So when 


computing #4) k? the total amount of time used in deciding membership 
3 


| oer T 


(n-He+1) 
in TH(S) is s . 27, (3°L(n +1, k))-2: n,kt1! 2 


s 2T,(3°L(n +1, k))°2 ‘ 


We lastly calculate how much time is used in computing F ek 
. a > 


k+l or in deciding membership 


which is not used in either computing % 
in TH(S). The total amount of space used in this way is the space on 


which a , 18 written plus the space to write Fatlsk,W for every 


k+ 


Ws 


ne plus the space to write dx, ax, mayeie ax, Futl,k,W for every. 


. . | \F, ket! 
‘: ss ; d UTE 2 2 
WSK yy this iss (L(n, k + 1)) IF etn! + Et 1, ))-2 ee 
lz | | | T, (ntk+1) 
n, k+l net 5a in 1p kb) = 5-2 7 ‘L(n +1, k). 


(3-L(n + 1, -k))*2 <2 


~68~ 
The time our Turing machine uses (aside from comput ing # etl 
: 3 
or membership in TH(S)) is spent in having the head go back and 


forth in this space doing the wecessary amount of copying; the reader 


Ty (rrHet+1)- ud 3 Ce sor 
aan verify for himself that this is < (5-2 “Lim +1, k)) 
some constant igs’ | 
So the total amowmt of time used in computing, 7 as 
o* 
T, (Hel) T,, (eeHet1) Ce 


=T(in+1,k)ST(n, k+1) + 27,(3-Lin + E,, Kye 22 ee? + L(nt1,k)) 


Since T,(n) 2n eel Ty (m) z 2" for abi n € N, we cap. calcubate that . 


for some constant Ces 


g(t) og 


Tin + 1, k)} S Tt, ki + 1) + [TCT (a +k +2 )) ds]. 


It can also be seen that the time needed to write down o.. is 


é 
polynomial in the space needed, and therefore < (L(0, k)): ? for some 


constant ¢.. Obtailatag Fo tc from S. is certainly quicker than obtaining 
c c, (k+l) Ce 


F, 4 from Fy yyy» 80 we have T(0,k) < (L(0,k)) ” + [2,((Tp(k #2 )) }°. 


Doing some final calculations we can conclude that 


: We are using the fact that we can simultaneously use space for two 
different purposes. For instance, some of the space on which sentences 
are written down is alse used for deciding truth of sentences in 8. 
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e(ntk+1) 


T(n, k) < [T, ((Ty@m +k+2)) 1° for some constant ¢ and all 


n,k EN. 


Lemma 2.3: For some constant c, there is a procedure which given n, 


writes down the sequence F |. ce ee steer ae, within time 


[T, (T,(m +2))cMt ie, the length of this sequence is < (T,(n 42))cCrtT) | 


Proof: When we were calculating above the time to write down # go we 
ue é 7 


were calculating as well the time to write down the sequence 


0,n’ 1,n-1l 


F F Z ees ae 


The length of the sequence is 


ce (n+1) 


s(n + 1) (T,(n))+L(n, 0) Ss (T,(n +2)) for some constant c. & O 


Remark 2.4: Note that every member of Fy 0 must be a true sentence and 
hence define the set whose sole member is the empty set. Therefore, 


Lemma 2,2 implies that M(n,0) = |%, 9| = 1. 


Definition 2,5: For every n, k CN, let Fa k be that member of F 


sk 


which defines [e“} oe That is, F 


nik fe (cheap iqes, mentee of oe such 


that $ F Fa e(e’) (where F(e*) is the formila (of &)- 


obtained by replacing free occurrences. of xy by e, for 15 i< k.). 


-70- 


Lemna 2.6: For some constant c there is a procedure which given n, writes 
down the sequence 


F F F within time 


O,n? “1nel? ***? “n,o* Fon? Fiynea? oor? F 


n,O 


(tT Cee 3 the length of the eoaveac* is < ae Nae + aye", 


Proof: First compute the sequence 50 on? » Fy wed? ot"? #0 as in Lemma 2.3. 


Then for each k, O<k <n, and for each FES, niet Mette nem formula 


I 


F(e“ ); each of these formulas will be of length < = 2 and there are at 
most (T,(n))+(n + 1) of them, ‘Then use he decision procedure for § ta 
decide each of the sentences F(e“), and then consolidate the information 


on the tape.. 


The time used in deciding each sentence F(e“) (and returning the head) 
is < 27; (L(m,0)), eo the Saret time used in deciding truth of peptenees in 
8 is < a +1). 

So the time to write down S, 0,n 7 nel? *°°? #n,0 oie eeties used 
in deciding truth of sentences is < 


IT, (CT, (n + 299°) 


> f+ (27, Gim)))-(T,(a))+(a + 1) fore es in 
Lemma 2.3. As in the-proof of Lemma 2.3, the remaiming time used is 


polynomial in the space in which Fon? "1 net? eer #0 ‘amd all the _ 
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’ sentences F(e*) are written, which is s 2(T,(n +2))CCrtD | 


L(n,0) < (T,(n +2 ))°"*)) 


and so we calculate that for some other 


constant c, the neAvance Fo on? Fy nel? a aerg #n,0° Foun? 1,n-1? aeety Fn,0 


e(nt1), \¢ 


can be computed within time [T, ((T,(n +2)) and its length is 


< (T,(n +2 ))° OD, 


Definition 2.7: For all n, k € N and every F € ce define W(F) 


rk? 


to be the set such that F = Fk,WCF)* 


_ k 
. t 
Remark 2.8: If n,k € N and F € F tik and F' € kal and a, E€s 
such that § + F(a), then 


F' € W(F) @ for some a,,, €S, 3+ F'(ay44)- 


. a 2 * 
We are now ready to consider the structure 8 ='<S , Ri» wtasery Ro» e> 


as defined in Chapter 3, For each n,k € N let 5 be defined on s* and on 


* * 
(Ss yk as in Chapter 2 and let. E be defined on (S ig as in definition 


3.1.5 and let u(n,k) be defined as in definition 3.1.2. 


Definition 2.9: For each n,k € N, define 


* . 
F = . pe 
n,k {vV: No Fl for all but finitely many i € N, V (1) rk? 
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For every V € # ., define [|v{| = Min (1 €n| for all j 24, Vj) =F. 4} 
n,k n,k 


= the norm of V. For every £, e s*5*, let ve be the unique member 
% 


f 


such that V, 7 (4) defines (£(4)1, fer all 1 €N. 


* 


* 
n,k 
* = *k 
Remark 2,10: For every V € Fe k there exists some f, € (S )~ such that 
bd 


. Also note that if k = 0, we have IF A = 1 and so 
Ld : 


hay 
tt! 


Proof: If ‘ne, ‘nee, then for every i € N, ff@)1, = fg. (4) 1» 


meaning that £04) . & (i). This implies that fy Ea 8° By Theorem 


3.1.8, & = §,. . oO. 


* = 
Definition 2,12: Let n, k € N and V € a k and let F(x,) be a formula 
? 


= * 
of q-depth <n. Let fi € (s yk be such that V = v5 z° Then we say 
*"k 


* 
Vr F iff + F(£). 


By Lemma 2.11, this notation is well defined. 


* 
Remark 2.13: If n € N and V € a and F is a sentence of q-depth <n, 
3 


0 


279s 


then VF F iff 8° FF. 


* * 
Definition 2.14: Let n,k € N. Define the map EX: Ftd, k ad PCL ict 
(where EX stands for extension and P(A) is the set of subsets of A) as 


* te 
follows: TeVeEeRy and V' € & 


1k n ke? then V' € EX(V) iff 
ry 2 : ont a: 


a) for each i € N, V'(i) € W(V(1)). 
and 


b) [lv'l| s [lvl] +pm+k +41, 0). 


Lemma 2,15: Let F(X 44) be a formula of q-depth < n and let. 


VE Fuels k Then V F ce F(x.) ® for some V' € EX(V), V' F F(X) 


Proof of € : 
Say that V is V where a € (s*)*, and that V' is V_ — 


n+l pr Me Byay | 


k 


; _ * Ket] 
where Bt € (Ss ) and say that ‘neat € ™ Vat, £, and 
Vasigyy * Fan) wOOee ardenth (FD =m 


(1) 


Let 1 €N. We have Ve, £, defines caRC® Rey and 


Ve-7- 
MBit] 


defines [Sp OL) ], and Vv, i € Wn 8 1): "By Remark 2.8 we 


Shy 
can choose £0) € § such that El, = (S41) la 


SoV'=V¢ and V' F(x,,,)+ By Definition 2.12 
“ict 


t — 
where we assume Bx FO) is annotated by x), X5, ..., X,. 
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* — * —_ 
8 F F(f44)s and therefore 8 + SF CA ha): So 


ve 3, * Beet? Fea) 

| Proof of > : , oe 
‘Say that VE 57 yy such that VF Six, (41) where q-depth (F) <n. 

For i 2 IIvll, V(i) defines fe") aa there toes there wictete £, € (s*)* 


such that £(1) = e* for 1 2 ||v|| and such that V(i) defines [eacoy s 


for i€éN. SoV= Yat, £," 


Since 3° + nF Ey, yj)» We cam find £ é s* such that 


: _ 7 _ a 
8 F F(£,5£). £ Fotl fue #0 the proof of Lemma Bete? shows that we 


* =a = 
can find fetl € S such that (££) En ttl and such that fh) = . 
whenever i 2 Vy Z| +u(n +1, k). By Lemma 3.1.8, 
(Epo fE fear 7 (Eye) fea PSF PCL): 


= has norm 


s IIV41,2,| | +u@ + 1,k) < [Vue 2! + p(n +k + 1,0), and 
clearly ‘aE F(X) For = LEN, Yat, £ ee 
[£,.(4) tl and Yas Ean defines fey) I implying (by aaa 2.8) 


that Mise c Wat 2, (1) es € nie 
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Lemma 2.16: Let F be the formula Q5%1 2X5 aets Q 6%) where G is 


* 
quantifier free. Let V, € Fh Then 
, 


0° 


* 
Sob F ® (Q,V, € EX(Vp)) (QoVo € EX(V,))---(Q.V € EX(V__,))(V FG). 


* 
Proof: S&S FF® Vo Ft F. By n applications of Lemma 2.15 we. have 


Vo FF @ (Q,Vy € EX(V5)) (VW, F Q5x405%3 «+e Q.x G(x.) 


wee @ (Q,V, € EX(Vp)) «-. (QV, € EX(V,_1))(V, F G(x,)). 0 


Theorem 2.17: Say that T,: N 7 N is such that TH(S) can be decided 


1 


by some algorithm within time T, (a) and such that T,(m) 2 2" for all n€N. 
Say that Ty: N.?N is such that To(k +k') 2 M(k,k') and Ty (k) 2k 


for all k,k' EN. (Assume T) is nondecreasing.) 


* 
Then there exists an algorithm for deciding TH(S ) which operates 


within time [T, (CT, (n +2))o" 18 for some constant d. 


Proof: By Theorem 1.4.2 it is sufficient to consider the sentence F of 
the form Q4%425%5 ne Qn) where G is quantifier free and of length 


at most n log n. The decision procedure proceeds in three steps. 


Step 1: ‘Compute the sequence 


a % 


O,n 1,n-1? @ees n,0? Fon? Pinel? eeeg F,,0° By Lemma 2.6 


296 


ye(HtL), 4¢ 


this can be done within time (TCT, (a +2 )) and the length 


of the sequence is *(T,(n +2 eer). 


Step 2: Compute u(n,0) (say, in unary). 


pon,0) = 1% 11%) gle" IR_y yIs (Z@))", So ufm,0) can be 
computed and written down using at most (T,(n))" more tape squares 
than those containing the sequence computed in Step 1. 
Step 3: Say that ¥ 0 = {Vp}. We want to decide if 
(Q,V, € EX(Vy))(Q,V_ E EK(V))) ».- (QV, E BK _1))(V, & G). 
To do this we have to have a way of writing down representations of 
members of pd for 0<1i£n. Our convention is as follows: if 
ve Fy ys then REP(V) is the sequence V(0), V(1), ..., v¢||vl{). 

Now if Vo» Vy» ae ve is a sequence such that Vas € EX(V,) 
for 0< i<n (where V, € 5 9) then re IIvol| = 0 and 
Eee < IIv,1 + u(n,0) we see that Iv, 1 < isp(n,0) for 0 <i <n. 
So for each Q,> 1 si <n, set aside (1¢0,0))-(144-(n,0)) additional 
tape squares; this is enough space to write down the representation of 


* P 
any member of Fy 1 of norm < i-y(n,0) (since L(m,0) 2 L(n - 1, 1)). 
‘ ’ 
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Claim: There exists a procedure which given 


' 
*i,0° F-1,V? eee, Fon! Fn,0? Fnel,1? aces Fo,n’..? Y as input, where 


* f 
y* REP(V) for some V € baal 0<i<n, determines, using 


@-i,i’ 


no more space than the input takes up, whether or not y' € EX(y). 


Proof.of Claim: Say that y is the sequence y(0), y(1), e+, Y(J) 
and y' is the sequence y'(0), y'(1), ... y'(J') for some J, J' € N. 


We. first calculate i (say in unary) such that y(0) has free variables 


* 
exactly KyoXps vers Xy3 that is .y = REP(V) for some V EF 


Assuming i <n, in order to ensure that y' € EX(y) we need only check that 


1) y' is a sequence of members of 7 1? and J' <.J + u(n,0). 


wiel,it+ 
1 ’ ty. ; ' > 1 te : 
2) y's") F-i-1,441 and if J' > 0, then y'(J'=1) # Fani-1,i41° 


and 


3) for every j 2 0 such that j < J and j < J', we have y'(j) € W(y(j)). 


For every j such that J< js x, we have y'(j) € W(y(J)). 


1), 2), and 3) can be checked using no additional space, and so 


the Claim is proved. 
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Now to decide F, cycle through each quantifier space appropriately. 


That is, use the space set aside for Q, to cycke through the représentatives 


of ree EX(Vp)» obtaining different tae for REP(V,), the space 
set aside for ® to cycle through the representatives ‘of the members of 
each EX(V,); “is: ‘For every particular vabue of V_ € F), , looked at, 
we have to decide from REP(V) if V, + OG). ‘It is suffictent tobe 
able to test if 7 + G(x) for each atomic formula G)(x_) ogcurring in 
G. But recall thet for every i €'N, v0) is simply a.conjunction of 
atomic formulas er negations of atemic formulas. ‘80 v,  Go@,)) LEE 
for every formula FES) of the sequence RER(V)» &5 €W(F). So 
TH(S’) is aie Resting if Va + G uses only the Space on which G 
and REP(V_) are written. 

The total ee used tn Steps 2 and 3, including the output of 


Step 1, 1s < (T,(n + 2))°™) 4 (ry(m))” + ne (L(m,0))+(1 + meu(n,0)) 


output oFStep 1 Step2 = Step 3 
(the n log n space on which G is written is insignificant). The time 


used by Steps 2 and 3 is at most exponential in this bound. Since 


e(nt+1)_ 


u(n,0) = (To(n))™ and L(m,0) = (T(n +2)) ; we have that the 


~79- 
‘ : ‘ dn, ,d 
total time used in all three steps is < [T, ((T,(m +2))")] 


some constant d (since the length of a sentence is > 0). a) 


Corollary 2.18: Let S4> Sos ¢ EN, S1 2 1 and S5 2 2, such that TH(S) 


can be decided within time 
cn n¢ (ntk) 


2 
on height s, a height 5 
2 and such that M(n,k) Ss 2 for 
all n,k EN. oc 'n 
se o* $ height 8, + Sy 
Then TH(S ) can be decided within time 2 D for 


some constant c'. 


Proof: Immediate from Theorem 2.17. | 
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Section 3: Results about Other Kinds of Direct Products 


In this section am state some ieedliew about other kinds of direct 
products, thus giving quantitative versions of some additional theorems 
of Mostowski and Fefermen and Vaught [Moe52, FV59]. We will not present 
proofs here, but our results follow from extensions of the ideas in 


Chapter 3 and the preceeding parts of this Chapter. 


Definition 3.1: Let I be a nonempty set, and let 3 &2)| 1 €1) bea 
collection of structures for £, indexed by I; say that 
gs) 2<s a) AG) af), el! > tor all der. Let 


D={f: 17 Us) | f£(1) e 5) for 1 € I}. For each j, 1s j s 4, 
LEI 


+ = 
€D-, then £. CR, iff 


t 
define R. © DJ as follows: if . hace 


j j 


#() € a) for all i € I. Define e € D by e(1) = e°4) for all 1 € I. 


Define the gtrong direct product of the system aft) | 4€X) by 
(1) 
STRONG (3 | 4 €1) =<p, Ri, Roy caer Ry, @ > 
Let D'S D be the set (f €D| for all but finitely many 1 € 1, £(1) = ey, 
c 
and let m be the relation R, restricted to (D') J 
for 1s j < 4, Define the weak direct product of the system 


(8 | 4 € 1) by wea | i € 1) = <D', RI, RE, oo, RE, OD, 
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If I is finite, then stronc($‘!) | 4 € 2) = mx@e) | 4€D. 

If we take I to be N and 3) _g for some fixed structure $ 
and all 1 € N, then we denote stronc(s ‘2 | i € N) by $” and call it 
the strong direct power of $; weaxe()) | 4 €N) is 3*, the weak 
direct power of 8, which was defined earlier. If P is a nonempty 
collection of structures, then STRONG(P) is the class 
cstronc(s“t) | ie 1) | ris weet and 32) €P for i € 1) and 
WEAK(P) is the class | 


qweax(3“) | 4 € 1) | ris a set and 8) CP fori ey. 


Mostowski shows that if TH(S) is decidable, then TH(8 ): is decidable. 
Feferman and Vaught show that 
TH(STRONG(P)) = Tac(strone($‘!)|4 € 1)| 1 is a finite set and sep ai 4€T}), 
and if TH(P) is decidable, then TH(STRONG(P)) and rmCWEAKC) are decidable. 


We can prove stronger versions of these theorems. 


Theorem 3.1: Let 8 be a structure and let M(n,k). be defined as before 


(Definition 2,2.5). Say that Ty? NN is such that TH(S) can be decided 
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by some algorithm within time T, (mn) and such that T,(n) 2 2" for all 


n€N. Say that T):N ~N is such that T,(k + k') = M(k,k') and 


2 
T, (k) zk for all k, k' €N. (Assume T, is nondecreasing. ) 


Then there exists an algorithm for deciding m3”) which operates — 


within time [T, ((T,(m +2 yy 9p 14 for some constant d. 


Definition 3,2: IfP is a collection of pituctuve, let 
INFSTRONG(P) = (stronc(3“!) | 4 € 1) | I de an infipite set and 
gs ep tor ie ny. 

Let INFWEAK(P) ‘ cweaxs (1) | 1 € I) | I is an infinite set and 


8) ep prien. 


Theorem 3.3: Let P be a nonempty collection of structures and for each 
SEP, jet Mg (n,k) be defined for 8 as before (Definition 2.2.5). Say 
that T,: N7WN is such that TH(P) can be decided by peas algorithm 
within time T,(m) and such en T,(n) z 2" for all n €N. Say that 

T,: NN is such that To (k +k') 2 Mg (k, k') and Ty (k) 2k for all 


k, k' EN and all § € P. (Assume T, is nondecreasing. ) 


. Then there exists algorithms for deciding TH(STRONG(P)), 
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TH(INFSTRONG(®)), TH(WEAK(®)), and TH(INFWEAK(P)) which operate within 


dn 
time pr, (222) yi for some constant d. 


It is important to note that in Theorems 2.17, 3.1 na 3.3, the 
decision procedure that is produced is obtained effectively from the 
one that is given. For instance, in Theorem 3.3 TH(STRONG(P)) is 
completely determined by TH(P). 

Now let P be the collection of finite cyclic group structures. 
Since every finite abelian group is isomorphic. to a finite direct 
product of finite cyclic groups, the first order theory of finite abelian 
groups is the same as TH(STRONG(P)). TH(P) is decidable, and we could 
have used the technique involved in proving Theorem 3.3 to prove Theorem 
3.2.8. Every finitely generated abelian group is isomorphic to a finite 
direct product of cyclic groups IMB68 J. So if P' is the collection of 
cyclic group structures, then TH(STRONG(P')) is the first order theory 
of finitely generated abelian groups. But using results of [Szm55] it 
can be caliown that TH(P) = TH(P’), and so by iheoren 3.2.8 we see that TH(STRONG(P')) 


gen j ‘ : ‘ 
can also be decided within space 22 for some constant c. 
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Section 1: Introduction 
A pairing function is defined to be a one-one map 9: N X N 7N. 


The language £ we shall use to talk about pairing functions in this 


chapter is the usual language of the first order predicate calculus with 
the formal relation ptv,, Vy) = V3. If p: NX NWN is a particular 


pairing function, then we can interpret fotmufas:and senterices of £ 

in the structure < N, 9 > in the obvfous way; by a Péstructure we shall 
mean a pafr <N, p > where p is a patring finetion. Léet be the: 
collection of alf ‘P-structures. Note that although equality is not a: 


formal predicate of £, we can défine equality in P by writing 


¥x(p(v,.v,) = X > P(vy,V)) = x), which we will henceforth abbreviate 


as Vv) = Vo (where: vy and Vy. represent formal variables). In [Ten74] 


1 


Richard nentey Satire to some unpublished results of Hanf and Morley 
which show that TH(P) is udecidable. We will wreuent our own, proof of 
this in Section z Tenney also proves that the theories of a large 
class of pairing functions, including the most common examples, are in 
fact decidable; however, none of the decision procedures for P«structures 


that he arrives at are elementary recursive: 


In an earlier version of Temey's work [Ten72] he presented some 
elementary recursive algorithms which were supposed to be decision 
procedures for some theories of pairing functions. We pointed out to 
him that this was impossible, and he has since written a corrected 
version [Ten74] in which all the algorithms presented are non-elementary 
recursive. 
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The major result of this chapter will be that this is an intrinsic 
difficulty of pairing functions. We shall show that no nonempty 
collection of Sestructires (and hence no siieie Peeteucuiray Waa 
an elementary recursive theory. 


Definition 1.1: Define f: N+N by £(1) = 22 Jhetsht 2 ayat as, 


£(0) = 1 and £(4 +1) = 2°) for 4 2 0. 


Theorem 1.2: Let C be a nonempty collection of P-structures. Then 


NTIME(f(n)) = perH(c). 


Theorem 1.2 will be proved in Sections 3 and 4. Using the methods 
described in Chapter 1 for proving lower bounds, Theorem 1.2 yields the 


following corollary. 


Corollary 1.3: For some constant c > 0, the following is true: Let C be 
a nonempty collection of P-structures and let be a nondeterministic 
Turing machine which recognizes TH(C).- Then for infinitely many n, there 


is a sentence in TH(C) which RM takes at least £(cn) steps to accept. 


We have remarked that Tenney shows that many pairing functions have 
decidable theories; in fact, some of the decision procedures that he 
siegente run within time f(c'n) for some coanemit c'. So the lower ‘sounds 
of Corollary 1.3 is achievable (except for the value of c). 

We conclude this section with some simple generalizations of 


Corollary 1.3. 


| Definition 1.4: “Let n be an integer > 2. Then an n-ling function 
is a one-one map p: xn" aN. £. the ‘language for n-Ling functions, 
is the language of the first order predicate calculus with the formal 
predicate P (V4 »Vos eee, vn» * Veal’ An neetructure is a pair < Nip > 


where p is an n-ling function. 


Corollary 1.5: Let n> 2 and let C be a nonempty collection of n-structures, 


- Then TH(C) has no elementary recursive décision procedure. 


Proof: Assume for convenience that n = 3; the other cases are handled 
similarly. If p ie a 3-ling function and a € N, define the pairing . 
function Pe by Py (a1 »@y) = P(a,&,,85)- If F is a sentence of £ (the 

language of pairing functions) and x is a variable not occurring in F, 
define F'(x) to be the formula of £, obtained by replacing every atomic 
formula of F of the form p(v,,v,) = Wy by A(X, .V5) = Vy: It is easy 


to see that for ary 3-structure < R,p > and any a € X, 


<N, p> F'(a) @<N, p >b F. 

Now let C' be a nonempty collection of aosttustues and define 
c= {<N, Pp. > | <N,p>€c'! ea ‘ EN; e is a nonempty collection 
of P-structures, Let F be a sentence of £, Then Ct F @ for every 


<N,p > €C' and a €N, <N,p. 7 F F @ for every <N,p >€ C' and 
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a €N, <N,p >F F'(a) @ C' F YxF'(x). An elementary recursive 


decision procedure for TH(C') would therefore yield an elementary 


recursive procedure for TH(C), contradicting Corollary 1.3. 0 


Our goal in. this section is to -preve. that the set oF sentences 
true of all P-structures is not recursive, awl ee: some individual 
P-structures .aleo ‘have undecidable theories. These proofs are due to 


the author, Jeanne Ferrante, and Robert Hossley. 
Definition 2.1: Let £,, REL (*1°*2) be the formula 


ax, ax (9 (529) = %3 A P(X35x,) sal ). 


If § = <N,p > te .a Pastructure, define 
REL(S) = ((a),a,) €N | 8+ FL (e,.a5)}- 


Let N, S'N be the set of even, nonnegative integers. 


Lemma 2,2: Let R <-N, x N.- Then for some pairing function p, 


REL(< N,p >) = R; furthermore, we can choose p to be onto as well 


as one-one. 


Proof: Let (a,sb)), (a,,b5); oe. be an enumeration of yn? such that each 


‘pair occurs exactly once and such that b, # 2i for each i € nv. (For 
instance, we can choose an enumeration (0,0), (0,1), (1,0), (0,2), (1,1), ... 
where the number s grow sufficiently slowly to ensure that by # 21.) We 


will new define the sequence P (8,504) ,PCa5sb5), ereiaheg 
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Let n € nt and assume that p(a,,b,) has been defined for 


0<i<n; we now define p(a,b ). 
Case 1: (asd) as Define pCa, »b) = 2n. 


Case 2: db, = 2i + 1 and as 2i and (a,,b,) ER. Define P(a.,b.) = bi: 


\ . 


Case 3: Otherwise. Let m be the least member of N such that 
a) m is not equal to either 21 or 21 +1 for any i such that (a, »b,) ER. 


b) m € (p(a,,b,) |i<yn 
and , 


ec) m #b.. 


Then define p(a,»b.) =m, 


We first show that p is one-one. Say that p(a,,b,) = p(a, yb, ) = J. 


If J = 2i where (a, ,b,) € R, then both pCa, »b ) and p(a,,b,) must have 


j 


been define via Case 1, so j =k= i, If J = 2i + 1 where (a,5b,) ER, 


then both p(a ) and p(a, sb.) must have been defined via Case 2, so 


rae 


by = b, = 2i + 1 and a, = a 2i. If we do not have either J = 2i 


or J = 2i + 1 where (a, ,b,) € R, then both PCa, sb.) and p(a,,b,) must 


have been defined via Case 3; by Case 3b), we must have j = k. So 


p is one-one. 
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We will now show that p is onto. Let m€ N. Assume that p 
is not defined to take on the value m via either Case 1 or Case 2. 


Then we do not have m = 2i or m = 21 + 1 where (a,»b,) ER. Let 
S = ((a,b) EN | DEN, anda €N, and b¥ mj}. p cannot have been 


defined on any member of S via Case 1 or Case 2, sop Bars have 

been defined on every member of S via Case 3. Since S is infinite, 
{(a,b) | p is defined on (a,b) via Case 3 and b fm} is infinite. So 
p eventually takes on the value m via Case 3, and hence p is onto. 


It remains to show that REL(<N,p >) = R. Say that (a,,b,) € R. 


By Case 1, p(a,.b,) = 21, and by Case 2 (since Case 1 doesn't apply to . 
(21, 24 +1), p(2i, 24 + 1) = 24 + 1 and hence (a,»b,) € REL(< N,p >). 


Say that (a, ,b,) € REL(< N,p >). Then for some c € N and some j ent 


we have (0 (az obi) se) ze (aj.c,) and p(ay.c4) . c, Since we can't have 


? 


c,=2j, p camot have been defined on (a,.c,) via Case 1, and looking 


j 


at Case 3c), we see that p cannot have been defined on (a,,c,) via Case 


J 


¢,) via Case 2. This means that c, = a, +1 


3. So p was defined on (a;, 
and a, = 2k where (a, »b,) € R3. per is, p(a,sb,) = 2k and (a,b, ) € R. p(a,,b,) 


cannot therefore have been defined via Cases 2 or 3, and therefore we have 


that i = k and p(a,5b;) € Rk. i] 


Definition 2.3: Let ‘, be the language of the first order predicate 
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calculus with only a 2-place formal predicate REL. Define the class of 
structures for i, Cc = {<D,R > | R& p* and D = domain R} (where domain R 


for a 2-place relation R means {a | for some b, (a,b) € R or (b,a) € R}). 
Lemma 2.4: (Kalmar [cf. Ch56]). TH(C) is dudesidabie: 


Theorem 2.5: a) TH(®) is undecidable. 
b) There exist particular P-etructures with undecidable 


theories. 


Proof: If F is a sentence of i> let F' be the sentence of £ 


obtained in the following way: 
-1) For every quantification Qv in F, change it into a quantification 
over the values of v which satisfy Sx) Fepr (*1%2) A Wwe Xy Vv ¥ = Xy))- 


and — 


2) Replace each atomic formula of F of the form REL(v, »V,) by 


Gx, 8X5 (Fppy (4 Xo) A X,Y A Xo = Vo)« (We are assuming that neither 
x nor X occur in F.) It is easy to see that for any 8 € P and sentence 


F of a; < domain(REL($)), REL(S) >RF@Sr FY, 


t Actually, the theorem as stated by Church as TH({< D,R > | R&S D4) 


is undecidable, but Lemma 2.4 follows immediately from the proof. 
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Proof of (a): We will show that Ck F@P + F', 
Ct F = for all <D, R>EC,<D,R>FKF®*? 
for all 8 € P, < domain(REL(S)), REL(S) >+ F = 
for all 8 €P, 3b F' >PF F'. 
Conversely, P + F' ~ for all $ EP, Sb F' = 


for all 3 € P, < domain(REL(3)), REL(S) > F >. 
. (by Lemma, 2,2) 


for all <D,R> € C such that DON, <D,R > FL 
By the Skolem-Léwenheim theorem [cf. Men64], this implies that fer every 
<D,R>€C,<D,R>t F, implying Ch F. Sock FPF, - 

Hence, a decision procedure for me) errr ene for nu(C), 


contradicting Lemma 2.4. 


Proof of (b): It is easy to see that there exists some R SN. xX XN. 
such that N, = domain R and TH(<N_,R >) (in £,) is undecidable. (We 


can, for example, choose R to be an equivalence relation so as to make 


TH(<N,,R >) undecidable, as described in Section 4 of Chapter 2.) By 


Lemma 2.2 we can find 8 =< N,p > such that REL(S) = R. Then for any 


sentence F of i, we have < NR >F F@Sr P', So TH(B) ts undecidable. 


Remark 2.6: Let P' = (<N,p >€P | p 1s onto}. The proof of ‘Theorem 


2.5 shows that (a) TH(P') is undecidable and (b) TH(3) is undecidable for 


some 8 € P', 
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Section 3: Construction of Formulas Which Talk About Large Sets 


Our goal in these next two sections is to prove Theorem 1.2, i.e., 


that NTIME(f(n)) < petncc) for any nonempty collection C of P-structures. 


We shall do this as follows: Let Ibe a nondeterministic Turing machine 
over the alphabet 2. Then for every w € xt we will produce a sentence 


F, of £, such that for any P-structure 8, 3 Fr F, @ M accepts w within 


time t(\wl); furthermore, the time it takes to produce Fy will be poly- 
nomial in lwl, and the space needed will be linear in lw]. If M 
operates within time f(n) and C is a nonempty collection of P-structures, 


then we have C F Fy @ ® accepts w within time £({wl) © accepts w, and 
hence NTIME(f(n)) = perucc). 
The way EF, will "say" that M accepts w within time £(|wl) is as 


follows: We regard the instantaneous configuration of a computation of 
Mon w at any time as a string of length £(|w|), and hence the — 
concatenation of the first (f(|w| +1) / £(|w| )) (which is 2 £(|w|)) 
successive instantaneous configurations is a string of length £(|w| +1). 


Lae will "say" roughly that there exists such a string of length £(\w| + 1) 


which contains an accepting configuration. In order to write such 


sentences as FE, we will first have to be able to write down formulas of 


£ of length proportional to n which allow us to describe the basic 
set-theoretic relations on the subsets of an ordered set of size f(n' + 1). 
The above is an intuitive outline of our eapproech., The ideas for 


this outline first appeared in Meyer's proof. that WSIS is not elementary 


recursive [Mey73], and also occur in[¥iR74], {Fer74], [MS72], [SM73], [Reb73],{Sto74]. . 


In the rest of this section we shall shay how to write formulas of length 
| proportional to n which "talk about" sets of size f(n + 1); these 
iecreas do not appeal to any of these previous papers sins the 
development in this. jection is necessarily intimately connected with 

the nature of P=structures. In Section 4 we shall present a development 
along the lines of Meyer, etc., which shows how to use the formulas 


derived in Section 3 to prove Theorem 1.2. 


Let < N,p > be a P-structure. We first define partial functions 
4: NON and vr: NN as follows: for a €N, sa) = b if for some 
c EN, p(b,c) = a; r(a) = b. if for some c EN, p (c,b) =a. Since 
p is one-one, r and 4 are indeed partial functions. Clearly r and h 
depend on p, but it will always be clear fou: the context what pairing 
function a particular ¢ and £ come from. Let oa € (r, 8}. be a string; 
we define the partial function f£,: N +N in the obvious way, namely 


if X\ is the empty string then £, (a) = b iff a=b, and ifo is 


fo" (ro') then £,=4ef,, (=ref,,). Henceforth we will use o ambiguously 
to designate both the string in {r,4}" and the function f.. - 

Let Py 2) be the formula Hx, (9 (x5 5%) = x,) =e let Fy, (4 +9) 
be the formula x4 (P (x5 5) = %,)+ Then for any 8 € P and any a,b €N, 
SF F, (a,b) iff £(a) = b and 3 Fr F (a,b) iff r(a) = b, Since we will 


be expressing properties using the partial functions r md 4, and since 


we will be interested in writing down formulas that define these 


properties, it is important to realize that we will be implicitly 


using the formulas Fy and Fee 


Definition 3.1: Let < be the reverse lexicographical ordering on 


* 
{r,2} . That is,.o, <0, if either 0, = 0,0, for some 83 € {r, 8)", 


1 2 371 


* 
or if o, = oj ho and 0, = oro for some 0}, 04, 0 € {r,4} . 


Oo} < Oy means o < oc, and a # Toe 


All the properties mentioned in this chapter will be with respect 


to P. 


Definition 3.2: For each n € N, we define the property ORD, (459 Yo) 


as follows: let <N,p > €P, let a, b by €N. Then 


1? 
<N,p >F ORD (a,b, ,b,) iff there exists Fy rF, € (r, 4} such that 
(2) Joy] = ley] = e@) 
(IT) oy < iP) 


(IIT) o4a = b, and O58 = by 


1 


Remark 3.3: <N,p > ORD (a,b,b) iff for some o € (r,B°, 


£(n) 


|o| = £m) and ca = b. Clearly |(b| <N,p >F+ ORD (a,b,b)} | < 2 = f(n + 1). 


Definition 3.4: For n € N we define the property FULL, (x) as follows: 


let <N,p >€ P, let a€N. Then<N, p >F FULL (a) iff 


|(b | <N,p > + ORD (a,b,b)}|= £m + 1). 


Lemma 3.5: Let <W,p > be a structure and let n€N. Let 


o> Foe. sree OO be the increasing (with respect to <) sequence of 
2 


those members of {x," of length n. Let bj. bo» Rey bn be a sequence 


of (not necessarily distinct) members of N. Then there exists a € N such 


that o,a = b, for 1 <4 < 2". 


Proof: (by induction on n). 


Let <N,p > be a Pestructure. Lemma 3.5 is true if n = 0, since 


we can choose a = b- So assume the Lemma for n; we will prove it for 


n+1,. 


q 4 # 
Let by» bj» bo. bo» cece on on be a aedwence: ef members of N 


1 


of length or - Define the sequence c,, c,, «.«-, C . by ec, =» p(b,,b!) 
1’ “2 on 1 Voi 


for lsi s 2", Let Tyr Tos oes oon be the increasing sequence of 


* 
those members of (r,4) of length n. By the induction hypothesis, we | 


can choose a € N such that o,a = c, for 1 <i <2", By definition of <, 
ho,, T0,, 405, Fn, 200, 49 _, ro is the increasing sequence of members 
1 1 2 2 gn on 


f (L,r) of length n+1. Since & ke, = b, and b! 
of (4,r) of leng n 1. nee o,a = g7 rojas re, = 1? 


a is the element we were looking for. Hence we are done. O 
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Lemma 3.6: Let <N,p > € P and let a, n EN. Then the following two 
statements are equivalent. 


(I) <N,p >F FULL, (a) 


(II) For every a' €N, if (ORD (a,b,b) ~ ORD, (a',b,b)) for all b € NJ 


then [CORD (a',b,b) > ORD (a,b, b)) for all b € N] 


Proof: 


(I = II): Say phat FULL, (a) holds in<N,p > and that a' € N has the 
property that for all b EN, <N,p >F. ORD, (a,b,b) >< N,p >F ORD, (a',b,b). 
We have £(n + » = [¢b] <N,p > ORD, (a,b,b)}| = |(b] <N,e >FoRD, (a",b,b)) | 
< f(n + 1). Hence <N,p > ORD (a'b,b) ><N,p > ORD. (a,b,b). 


(II > 1): Say that II is true. Let A &N be a set of cardinality f(ntl) 
such that {b | < N,p >F ORD, (a,b,b)} SA. By Lemma 3.5 we can choose 

a' €N such that (b | <N,p >+ ORD (a',b,b)} = A, 80 

{b | <N,p>F ORD, (a,b,b)}= (b | <N,p >b ORD (a',b,b)}. So by II, 

(b | <N,p> F ORD, (a,b,b)} = (b | <N,p > ORD (a',b,b)} = A. Hence, 


|(> | <N,p > F ORD, (a,b,b)}| = [Al = £(n + 1) and so <N,p >+ FULL (a). O 


Remark 3.7: If <N,p >F FULL (a); then clearly Oa is defined for 


every o of length f£(n); furthermore, if lo, | = lo, = £(n) and oy # Oy, 
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then o,a # 0,8, Hence ((b,,b,) | <N,p >F ORD (a,b, ,b,)} ie a linear 


ordering on the set {b |< N,p >F ORD (a,b,b)} of cardinality f(n + 1). 


Lemma 3.6 showed how FULL, can be canara from = prepesty ORD, 
the purpose of Lemme 3.8 is to show how ORD. a be csovesiid from 
ORD and FULL - Let <N,p > € P and let a,b, ,b, EN Lesma 3. 8 says that 
<N,p >F ORD 1 (ab, »b,) if and only if there exists some c € N which 


"codes" strings 712% € {r, 4" of length f(n + 1) such that oa = b, 


and ¢,a= bo and oF < Joe 


; To see how this coding is done, examine Figure 1. 


Every node in the tree in Figure 1 represents a (not necessarily distinct) 
member of N. The value at a node is p of the values of the two sons 


(if they exist); for instance, p(g,h) = ¢. In order for ¢ to code the 
strings o, = Ye(nt1) °°* Yov1 and oy ™ 8 (mth) coe $484 it is necessary 


that d, = ¥; eo Yo¥ 4 and e, = 8, eee 69648 for 1 <is £(n + 1); note. 


that c may code numerous pairs of strings. In order to say that c codes 
strings Fy» such that 0, (a) = by and oy (a) = b, and 9, < C5, one has 


to be able to talk about the nodes labelled by Se he Loe Lhe De Se (ntl) 


and their ordering from left to right, and for this reason we insist that 
Cys Cos sees Ce (nt1) all be distinct so that we. can talk about their 


ordering using ORD: 
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Cc 
g h 
5 £(n) 
_ levels 
\ 
\ 
la | 
7 
~ ra \ } 
fo $ Ce (ntl f 
/ 
4 3 - d e 
2° -  * £(f1) £(A+1) 


Figure 1: 


Illustrating Lemma 5.3.8 
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Lemma 3,8: Let <N,p >€P, let n CN, let a,b,,b, €N. Then 


<N,p >F ORD, (asd, »b,) if and only if there exists c € N such that 
the following four facts hold. 


1) <N,p >F FULL, (¢). 


Let @)be the linear order imposed on the set. {b | < Np >F ORD, (c,b,b)} 
by ORD. Let €,,€9, «++, °£(nt1) be the elements ordered by © listed in 


increasing order (with respect to®). 


2) ble, 1s defined for 1 <i < f(n + 1). 


Define the sequence dood). weeny dent) by dy = a@ and 4, = hfe, for 


O<isf(n+ i. Define the sequence *or*1? Sisiey equ) | by ep 7a 


and e, = rfc, for O<is f(n +1) (rfc, is defined since she, is defined). 


1 


< , = = ; 
3) For O<i < £(n + 1), either d, rd or dy 4a, _y> and either 


= re.) ore, = hess: Also, d 


ey £(nt1) ~ 4 sod east)” 


4) Either d, = e, for all i, 0 <i =< f(n + 1), or there exists some i, 


i 


(O<4< £(n +1) euch that 4.1) d, =e, for 0 <j <4 and 4.2) 


d, = ld and e, = re 


i i-1 i-1° 
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Proof: Fix <N,p >, n,a,b,,b,. 


(If): Say that for some c € N, 1) through 4) hold. -If 0< i =< f(ntl), define 


Y, = Lifd, = Ady a> and yore if d, = rd 


1 


i=), d, # fds: If 


= £if e, = he _7 and 


i 


0 <i < f(mtl), define 6, =rife, = resi. and 6, 


fag tae cael 
e; # rey: Define 150, E (r,4) by o, = Yecnt1)**°Y2%1 and 


a = b.: and 


1 1 


c= Beant? °°9 294: It is clear from 2) and 3) that o 
Oya = bo. We wish to show o, < Co. If o, # Gy, then for some 1 we have 


¥j ~ 6, when OS 4.1, and y, # 6,. Sod =e, for O<j<i. If 


j j 


= = om ; a ; : = =d. 
gor 7 Sy Oy 7 SM guy = badge 8° Ad iy Fd oy 


By definition of Vy> Yq = 4. and. so 9, < op. If d, #e,, then by 4.2) 


= < 
i t-1° So vy & and o, 3 


by " fics * 
(Only if): Say that <N,p > F ORD 41 (4sby»b5)- Let 12% € (r,4) be 


such that o, < o, and lo, = lo,| = £(m + 1) and o,a = b, and o,a = by. 
Say that a day kagtts YoY¥y and that Oy is eee wave 
V5 € {r,4} and 65 € {r,4} for O<i< f(n + 1). Define the sequence — 
dosdi; eee qe (nt) by dy = a and 4, = ¥;4,., for O< is f(n +1). 
Define the sequence €),€), aoe, ee by ey = a and 2, §5@) 04 


for O<is f(n +1). Clearly d = b, and ‘e b,. 


£(nt1) i f(nt1) ~ °2 


Define the sequence By9Bo> oes Be (n+l) by 8, = p(d,,e,) for 


1s is< f(m+1). Define hy sho, are be (ntl) € N as follows: let h, be 


any element of N; for 1 < i < fim +L) det Boat be such thet. 
ee + +> ¥ p(s 4+h,) for any j, 1 <= 4< i. Gigs can be antes in 


this way since 9 is angzene.) Define the sequence at distinct members 


Clearly 4, = “tte, mde, = rhc, fori <i f(n +1). ‘By Lemma 3.5, 


we can find c € 8 such that if a 


7 Sige eee ett) are those members of 


(r,4)” of length £(n) listed in increasing order, then c, * a,c for 


1s is f(n +1). Clearly c satisfies properties 1), 2), and 3). 


If 0, = 95, then d, =e, for 0< i 5 f(fm4+1). Otherwise co, <o, 


1 2’ i 1 


implies that there exists i, O< i < f(n + 1), such that vy = 8 


if0<j<i, and y, = 4 and 6, =r, This means thet d, = e, if 


0<4< 1 and d, = ate] and e, 7 resp so 4) motes Bhaos - 0 
Lemma 3.9: There exists a sequence of formulas of £ 
ORD) (*5 94 2%o)> GRD, (X59) Vo)» eee such that 

(I) ORD (Xs¥4s¥o) defines the property ORD. for n € N. 

(II) There is a procedure which given pn € wt computes GBD. within 


time polynomial in n and space linear in n. 
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Proof: Define ORD, (X54 »¥o) to be 


[yy = ¥q A He(p(2,y,) = x V PG 2) & IV PCy 2¥Q) = Xe 

If we have ORD defining ORD ; then by using Lemma 3.6 we can obtain 
a formula FULL (x) which is of length proportional to the length of 
ORD and which defines the property FULL. Lemma 3.8 therefore gives 


a way to define ORD 


41 using cep 7 lee me completely rie aad 


if one notes the following fact: in Lemma 3.8 we occasionally quantify 
over i, 1s is f(n +1), but this can be expressed indirectly as 


quantification over the ordered. set (b | ORD (c,b »b)})". 


If one used Lemma 3.8 in the simplest way to write down ORD 41 
using subformulas ORD , then since ORD would occur more than once in 


ORD 


the length of ORD would be at least oideortlonal to i We 
can, however, use a result due to Fischer and Meyer lee. FiR74] to 
obtain (using Lemma 3.8). a formula ORD of length proportional to n 
which defines ORD, for alln €N*. This result is stated formally and 


is proven in Appendix 1. Thus by Thegrem A.2 of Appendix 1, we can conclude 


Lemma 3.9. i 


t It is at first difficult to see how to use Lemma 3. 8 ‘to write ORD ORD 44 


using ORD. as a subformula, since .the free variables of ORD are fixed 


and we might wish to use formulas similar to ORD but with different 
free variables at different places in ORD 41° @ way is by under- 


standing the phrase "using ORD as a subformula" to mean using 
formulas like ORD ‘but with the variable names changed. Another way 


is by the following trick: Say we have a formula F(x,y) and we wish 
to have a formula G(y,z) such that F and G define the same ‘property. 
We can let G be Wx, 2 Vxy ((x, =yA X» = z) > VxVy((x = x Ay= Yo) ~» F(x,y))). 
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Corollary 3.10: There exists a sequence of formas of {, 
FULL, (x), FULL, (x), «e- such that | 
(1) Wi, (x) defines the property FULL, for all né N. 
(II) There is a joavedure which eieat n € nad computes mil, ‘wikis 


time ely ublel in n and within space “linkee in n. 
Proof: Use Lemma 3.6 to express FULL using ORD for n € N. 


Lemma 3.11: There exists a sequence of formulas of £,. 
DIST DIST) (%+¥4 Vo)» leas wie ik eee Such that 


I) If S € P and n,a,b, sb. €N, then $ F pIST (a,b, ,b,) 


(1) SF FULL, (a) 


(2) 3b ORD (a,b, ,b,) 
(3) -. The distance from b, to by in the ordering determined by ORD. 


is exactly f(n). 
Il) There is a procedure which given n € nN computes DIST within time 


polynomial in n and space linear in n. 
Proof: _Let DIST, be PC¥ys¥o) = xA yy # ¥oe 
Let 3 € P, way » & b,, by CR. We wish to say that 8 FULL, (a) 


and |{c EN | c #by, and 8 F ORD, (a,b, 2c) and 3 + on, (a,,2,)| 7 £(n). 
(This implies that 8 + ORD (a,b,,b,)-) But by Lemma 3.5, this will be true iff 
8 FULL (a) and there is some c' € NW such that SF FULL ,(c') and such that 


for alle €N, 
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(s FORD, _,(c5esc)) 2 (c # b, and SFr ORD (a,b, ,¢) and $ 4 ORD (a,c,b,)). 


We can therefore write down a formula DIST (X54 »¥o) for n € N (by using FULL , 


ORD , FULL -1 and ORD -— such that (1) and (II). are satisfied. a 


Definition 3.12: For all n€N, let gee eae ae a be the property 
such that for S$ €P and n,a,b,,b, € N, & + SET 630d o by) ° 


8 + FULL (a) and & + ORD (a,b),b,) and & + ORD, (b,,b),by). 


Lemma 3,13: Let S$ € P and let n,a € N such that 5 F FULL, (a). 


Let A & {b | s Lg ORD. (a,b,b)}. Then for some by € Ny 


A = (b, | SF SET (a,b, ,b5)}. 


Proof: Say that S$ + FULL, (a) and A & {b | SFr ORD (a,b,b)}. Let A' SN 
be such that 0 < |A'} < £(n + 1) and A= A'(\{b | 8 & ORD (a,b,b)}. 
By Lemma 3.5 we can find some b, €.N such that | 


At = (by | SF ORD (b,,b,,b,)}+ Hence, A= (by | Sr SET, (a,b,,b,)}. O 


Lemma a3.14: There exists a sequence of formulas of £, SET SET) (%,¥, 29)» 
SET ("9 ,599): ee. such that 
(1) SET SET (%5¥4»¥o) defines the property SET for n € N. 


“an There is a ceceiate which given n € nt computes SET within 


~106- 


time polynomial in n and space linear in n. 


Proof: One can easily write down SET using FULL = ORD . ma) 


Note that by Lemma 3.5, FULL (x) is satisfiable in =y P-structure, 
Hence, the formulas FULL, and ORD allow us to ) write formulas which, no 
matter which P-structure they are interpreted in, talk about an n ordered 
set of size f(n + 1). Using Dist. we can talk about two mtahers of 
this ordered set being f(n) apart. Using SET we can talk about all 
subsets of this ordered set and refer to the basic set-theoretic, rekations. 
In what follows we will think of a subset of this ordered set as | 
corresponding to the binary string which is the characterietic sequence 
of the subset. It will be useful to be able to eipress the property that 


such a binary string begins in a particular way. 


Definition 3,15: For every y € (0,1) let START, (x,y,2) be the propetty 
such that if n= |y|, 3 €P, a,b,c EN, then 3 + START, (a,b,c) 1f€ 


1) SF FULL (a) 


Let @be the ordering determined on (b' | 8 b ORD _(a,b" »b*)} by ORD, 
Let a be the characteristic sequence (with respect to (2) ) of the set 
(b' | SE SET (a,b,b')} = (b' | St ORD (a,b',b') and 3+ ORD (b,b',b")}, 


i.e., @ is the binary string of length f(n + 1) determined by b, a and S. 
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£(m)-n_ 5 for some & € {0,1} Of length f(n +1) - £(n). 


2) w= y-0 
3) c is the n+ 1 smallest member (with respect. to © ) of the set 


cb! | Sk ORD (a,b',b')}. 


* 
Lemma 3.16: Let y € {0,1} , |y| =n, and let i € {0,1}. Let S €P and 
let a,b,c EN. Then SF START, (a,b,c) ® the following eight properties 
hold for some a',b',c' EN. 
b 
1) $ FULL, (a)- 


2) St FULL, (a") 


Let 3) be the ordering determined on {c" St ORD.) (ase"se"} by 


ORD are the first £(n + 1) elements 


tL" Say that Cp2Cos cer, © 


£(m+1) 


in increasing order (with respect to G)). Let 6) be the ordering _ 


determined on {c" | Stop (a',c",c")} by ORD . 


3) {c" | SFORD (a',c",c")}= {C4 sCos vee ce 


£(n+1)) . Furthermore, 


ne Gy Ci) for 1s j < f(n +1). 


> for 1 < j s f(n +1). 


4) SF SET ,,(a,b,c,) @ St SET (a',b',c 
5) S } START (a',b’,c'). 
6) St SET, (a,b,c') eie=l1, 


7) c is the immediate successor of c' in the ordering (Ql 


i we i" 
8) 8 does not satisfy SET,,,(a,b,c") for any c", CSc! ‘Gee 41)- 
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Proof: (3) says that the ordered set of sizé f(n'+ 1) determined by 
“ORD, and a' (and 8) is the same as the first f(n + 1) elements of the 


ordered set determined by ORD 


atl and a. 4) therefore says that the 


binary sequence of size f(n + 1) determined by SET and a' and b' is 


the same as the first f(n + 1) elements of the binary sequence of size 


f(n + 2) determined by SET,,, and a and b; 5) and 6) say that this 


sequence of length f(n + 1) begins with yi and 8) says that the rest of 
it is 00... . 7) says that c is the n + 2 smallest member’ of the 


ordered set determined by ORD tl and a. uh OD 


yin 


Lemma 3.17: For every y € {0,1} there exists a formula of £ 
START (x,y,2) ave that ; | 
(I) START (x,y,2) defines sae saat abd Sanh, for y . (0,1)". 


| tn at 
(II) There is a procedure which given y € {0,1} computes START 


within time polynomial, in lyl and spacé linear in ly 


e 


Proof: Let START, (x,y,z) be the formla dz'(p(z,2') = xA z #2"), 
Lemma 3.16 shows that START + can be expressed in a fixed way (depending on i 


but ind dent of ! | 2 ) 
ut independent of y ) using START.» together with FULL 39 FULL, , ORD 41? ORD» 


SE SET» and DIST 4 where n = ly]. All of these latter properties can be 


Tt? 


expressed in a fixed way from ORD» and so START. . can be expressed in a 


yi 


fixed way from ae and ORD - In order to conclude Lemna 3.17, 
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we have to use a more powerful theorem from Appendix 1 than that used in 


the proof of Lemma 3.9. Since for all n € N, ORD can be expressed in 


nt+1 
a fixed way from ORD, we can appeal to ‘a special case of Theorem A.9 


in Appendix 1 (in which ES = Fi) to conclude Lemma 3,17. 0 


Remark 3.18: For y € 0,1)" let START. (x,y) be the property such that 
Sk START) (a,b) @ for some c, St START (a,b,c). We will really only use 
the fact that we can write short formulas defining the properties START. 5 
the reason we have dealt with the more complicated START was in order 


to be able to express these properties inductively. 


In this section we will use the formulas FULL » ORD, 
DIST , SET, START to talk about Turing machines which recognize 


languages € NTIME(f(n)), and hence prove Theorem 1.2. 


Theorem 1.2: NTIME(f(n)) < psTucc) for any nonempty collection C of 
P-structures. | | 


' Proof: Let ® be a nondeterministic [-Turing machine which operates 


within NTIME(f(n)). In arder to prove Theorem 1.2 we epecify in 


detail (partly reviewing from Chapter 1) the nature of our Turing 


machine. The tape alphabet is 2, % € DZ, and has one head and one 

tape where the tape is one-way infinite to the right; initially the head 
is on the leftmost square of the tape and Ti never tries to read off the 
tape. Ifw€ ie then we input w to ® by having the initial tape contents 
be wi... . Let the state set of Mbe {1,2, ..., k) where 1 is the initial 
state and k is the accepting state. ‘T accepts w if there is some 
computation starting on w##... such that BM eventually enters state k. 

Let us assume that atte entering state k, & thereafter stays in state k 


without moving the head or changing the tape contents. Since % operates with- 


in NTIME(f(n)), if Tf accepts w then there is some computation of & on 
w which enters state k within £(\wl) steps and hence without leaving the 


first £(|wl ) tape squares. 
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Let w € a lw| =n. Let g(n) = f(n + 1)/£(n); g(n) 2 £(n), so 
if M accepts w there is some computation-which accepts w within g(n) 
steps. Consider now a particular ‘couputation of M on w which goes for 
g(n) steps without leaving the first f(n) squares. Let W € ail of 
length f(n) be the contents of the first f(n) tape squares at time i 
(where JM begins at time 0). Let U, € {0, 1, 2, ..., _* of eee f£(n) 
be such that Uy = of j of (n)-q-1 where at time i,RM is in state j and the 
head is pointing at square q (where the leftmost tape square is squaré 0). 


Let W = WoW. ie 


° d= 
Wecny u : 


"1 te “Us (ap F-To) ener 


\w| 


|u| = &(n +1). Define the marking string M-€ (0,1) of length 
£(n + 1) by M= (1 0F69"18™@. We will call (W,U,M) the computation 
triple of the computation (on w). (W,U,M) is an acceptice comp utation 
triple if k appears in U. Clearly wastes w - Re only if there is an 
accepting computation triple for w. | 

Let (W,U,M) be a computation triple for w é ge | w| =n. For any 
string y, let y(i) be the i + 1 member of ¥ so that 
We W(0)-W(1)> ... *W(f(mn + 1) - 1), etc. For every j, 0 = j < g(n), and 


every 1, 0s i< f(n), the values of W(j-f(n) + i) and U(4-f(mn) + i) tell 
us the contents of square i and whether or not the head is pointing at 
square i (and if so, then the state of M), at instant j. The rules 


(of the finite state control) of M together with the fact that we only 
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consider computations which do not leave the first f(n) tape squares 


put constraints on the valves of W,U, and M around place 


jef(n) + i + f(n) (L£ j+f(n) + 1 + f(n) < f(n + 1)), depending on the 
values of W and U at j-f(n) + i. 

For instance, say that 0 <k<k+ f(n) < f(n +1). Say that 
W(k) = 0 and UCk) = 5 and say that if Ris in state 5 with the head 
pointing to a square containing 0, then the machine is allowed to 
print 1 and move the head te the right and transfer to state 7; it is 
permissible therefore that: W(k + £(n)) = 1 and U(k + f(n)) = 0 and 
U(k + f(mn) + 1) = 1 and M(k + f(n) +1) #1. If U(k) = 0, then we 
must have W(k + f(n)) = Wk). The point is that there are only certain 
values of (W(k), U(k), Wek + f()), U(k’+ f(a) - 1), U(k + £(n)), | 

U(k. + £(n) + 1),M(c + f(m) + 1)) 

which are permissible, i.e., consistent with R These ideas are developed 


rigorously in [Ste74, Section 2.2]. 


Lemma 4.1: Let WEED", UE (0, 1, 2, -.-, K}» ME (0, 1)” be strings 
of length f(n + 1). Then (W,U,M) is an accepting computation for 
w € (0,1)", |w] =n, if and only if 

1) ME 1+(0;3}- and every contiguous £(n) eciabiel of M contains exactly 
one 1. | 


2) WE wept B® 


F@)-lirea, oy kp. 


3) U € 1-0 
4) For 0 < i < f(n +1), if M(i) = 1, then exaetly one of the numbers 


UCL), Ui + I), ..+, UCL + ffm) - 1) is nongerc. 
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5) For all i such that 1< i< i+ f(m) < f(n + 1), the value of the 7-tuple 
(W(i), U(i), WCi + £(n)), UCi + f(n) - 1), Uli + f(n)), uC + £f(n) +1), 
M(i + £(n) + 1)) is consistent with MT. 
and | 


6) U contains an occurrence of k. 


Proof: 1) through 6) say roughly that W and U begin with the right 
configuration, that the transition between any two successive, configurations 
of length f(n) (marked off by M) are permitted by the rules of TM, and 

that the accepting state appears in U. These are necessary and sufficient 


conditions for (W,U,M) to be an accepting computation for w. O 


Completion of the proof of Theorem 1,2: Let w € hie lw =n. We have 


shown that with formulas of length proportional to n we can talk about 
an ordered set of size f(n +1). Every subset of this set can be 

thought of as a string of length f(n + 1) over {0, 1}. Every sequence 
Yy? Yoo sors Y, of v strings over {0, 1} of length f(n + 1) represents 

a string of length f(n + 1) over the alphabet 0,1)” (the set of v-tuples 


containing just 1 and 0), namely the string y where | 

y(i) = (y, (4), Yo (1), ecaiag y,(1)) for 0s i< f(n +1); if 

DU COs Ly 2, sites A] | = 2”, we can think of Vy» Yoo eres ¥,, 28 
representing a string of length f(n + 1) over the alphabet 


ZU (0, 1, .-+, k} by coding ZU (0, 1, ..., k} into (0, 1)”. Say that ¥ is 
coded as(0,0,..0). Then the string wot )-0 


will be represented by 
v timeg 
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yo, 40 ese: re alas where y, € {0,1)” and is of 


length n for 1 si <v. 


Therefore using FULL, OW), DIST , SEL , START oe SEAR,» STARE 


we can write a sentence ES of length cn whieh euys that there exists 
(W,U,M) satisfying conditions 1) through 6) in Leama 4.1. That is, for 


any 3 CP, Fy, will be true ia § if and only if M aceepts w. Hence, if C 
is a nonempty colvection of P-structures, Rr, € THC) © accepts w. 


se te? < perHtc). | 9 
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Let £ be the language of the first order predicate calculus with a 


finite number of relational symbols &,, Ro» coo, Rye Let P be a 


class of structures for &. Henceforth all properties and all 
equivalences between formulas of & will be with respect to P, The 
purpose of this appendix is to prove that one can construct short 
formulas defining certain inductively described properties. 
Theorem A.2 below will essentially say the following: given a 


sequence of properties Gp» G)> -.- such that G is defined by a formula 


of £ and such that G can be expressed in a fixed way (independent of 1) 


i+1 


from G, using the language £, then for every i > 0 there is a formula of 


& 


‘ of length proportional to i which defines the property Gy. 

We assume for convenience that equality is definable in P, and 
hence for convenience assume that Vy = V9 is an atomic formula of £. 
We also assume that every structure in P has a domain of cardinality 


2 2. 


Now let k € N be fixed and let £' be the language of the first order 
predicate calculus which is the same as £ except that a k-place formal 


predicate R, has been sdied 


Wnty pate a ee ee ee NT Oe ee Ne ee ea? tag ae eee get gem ee 
- Two formulas of £' are equivalent if they are equivalent in any structure 
obtained by adding to a structure from P an interpretation for R. 
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Definition A.1: Let F(x,) be a formula of £' and let G(x,) be a 


property. We define an infinite sequence of properties, 
Gy)» G, Gy) ee» as follows: Let Gy (xy) be GO) = For every ieéen 
and for every structure & € P with domain S and for every a, € gk we 


say that S$ F G (a) iff SF F(a,) when the formal predicate R is 


i+l 


interpreted in $ as G, (restricted to 8), 


Theorem A,2: Let F(x) be a formula of £' and let Gy) be a formula of 
&£ defining the property G(x,). Let Go(x)> G, (x). ee. be the 
properties defined in Definition A.1. Then there exists a sequence 
Go (x) s G(x)» Soa OL epEwSe of £ such that 

(1) G; defines the property G, for each i € N. 

(II) There is a procedure which given i € nt computes G. within 


time a fixed polynomial in i and space linear in i. 


‘Theorem A.2 is due to Fischer and Meyer [cf. FiR74], working from 
earlier ideas of Stockmeyer [SM73]. A key part of the proof will be 


Lemma A. 3. 
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Lemma A.3: Let F be a formula of £'. Then there exists a formula F' 
of £' equivalent to E such that F' has exactly one occurrence of the 
predicate letter R; this occurs in an atomic formila in which all the 


k formal variables are distinct. 


Proof: Let F be a formula of £'. Since any formula of £' can trivially 
be extended to an equivalent one with at least one occurrence of f, 
assume that F contains at least one occurrence of R. Assume F is in 
prenex normal form so that F looks like Q,¥,QV_ +++ Q;v,A where A is 

a quantifier free formula containing m2 1 occurrences of the symbol & 


and where VyoVos eee V represent formal variables. Let us say that the 


J 


m atomic formulas of A in which ® occurs, from left to right are 


R(V419Vy 29 eens Vay» R (Vo49V 299 e@eg Voy)» eeey Rv Mn? eee, Vink 


where the symbols v for 15 ism and 1s j < k represent formal 


i,j 


variables. 


Let yy» Yy> Yor Yo» 20 V Vn be distinct formal variables not 
appearing in A. Let A‘ be the formula obtained from A by replacing 


RVs 9Vi 9» Seco: Va by ¥,* Yi for 1S i-S m. Since in every structure 
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of P there are interpretations of y and y' which cause the formula 
y = y' to be true, and intecceurations which cause y = y' to be false, 
we see that A is equivalent to 


7 = 
dy Ay sty oy, .-. dy dy (AA Alo ee 2308 sees Vay) 1). 


Now let y, y', Zyo%os cee, zy be distinct formal variables not 


occurring in IN [(y, = y!) & R(v,,,Vv Sees Ved ds 
1<i<m i 1 il le » “ik 


as (ty, = ye RVs Veo aezery Va! is equivalent to 
<isn : 


VyVy'Vz,...Vz A (yay, Ayl=ypA 


: k i<i<m 


(ty = Y)OR(z1 5225 geen Se 
So we have shown that F is equivalent toa formula, with exactly one 


occurrence of R, which occurs in the atomic forma &(x,). O 


Definition A.4: Let F(x,) be a formula of £ and let Ey 2%os Bone z. be 


distinct variables all of which are different from mae soos Xe 


(3, |x,) 


Then let F (2) be the formula obtained from F in the following way: 
If v is an occurrence (not necessarily free) of a formal variable in F, 


then if v = z, for some i, 1 < is k, replace v by x,; 


1 fe if v = Xs for some i, 
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1<i<k, replace v by Ze 


Definition A,5: If F is a formula of £, define the size of F, 8(F), to 
be the length of F when each variable subscript is counted to be of 


length 1 and all other symbols are counted normally. 


The following lemma follows immediately from the definitions. 


a lx) 
Lemna A.6: Let E(x) and F (2) be as in Definition A.4. 
CES) 7 (mlx) 
Then s(F) = s(F "ek ), amd F(x,) ‘and F “eI (2) define the same 


proper ty ° 


Proof of Theorem A,2: Let F(x) be a formula of £' and let G(x) be a 
formula of & defining the property C(x, )- By Lemma A.3 assume that F 
contains exactly one occurrence of 2; the proof of Letima A.3 assures us 
in fact that we can insist that the atomic formula in which R occurs is 


R(z,) where Zy> Bor soos % are distinct variables not occurrirg in — 


k 
(X1>%o> eoees x} ° 


Now aetins a sequence Go (%)s G(x); sels o formulas of £ as follows. 


Let G, be G. For all i € WN, let 


1e7 be the formula obtained by 


Sey 
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| (z, [x,) rs 
substituting Gc; ki*k for R(z,) in F. It is easy to see by induction 


(using Lemma A.6) that G, xy) defines G, Gy) for each LEN. 


| (21x) 
For cy = [FI we have 6G.) Ss Co + s(G, d= cy + 8s(G,) 


for i€ N, so s(G,) < s(G) + iec,, Every variable occurring in each Gg, 


0° 
is either from the set {X»X5» eos x) or occurs in F or occurs in G. 


If cy is the maximum length of any such variable subscript, then 


at 
Is, | < c,°sG,) < c,°(8(G) + icp) S cei for i €'N and some-constant c 


independent of i. It can also be checked that one can compute S, 


within time polynomial in i and space linear in i. © j DB 
Remark A.7: Theorem A.2 can be improved in a number of ways. Firstly, 


we can obtain our result even without the restrictions that equality be 
definable in P and that every structure in P have a doacain of cardinality 
22. Im addition, using a trick suggested by Solovay ([Sol73] we can obtain 
the same result even if our language of the predicate calculus doesn't 


contain ©, 


Theorem A.2 can be generalized in ecaaber of ways. We will only 
present the particular generalization which we need in the text. 

To begin with, let £" be the language of the first order predicate 
calculus which is the same as &£ except that we have added two new formal 


k-place predicates: R and R' for some fixed k € N. 
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Be = Pe jeg ' 
Definition A.8: . Let Fy (a> F, (x,)> FAC,» FiGy,) be formulas of {£". 
me ~ * 
Let G(x,) and G'(y,) be properties. For every y € {0,1} we let 
ED) and cy) be properties as follows: If \ is the empty string, 


* 
let G, be G and let Gy be.G'. For every 5 € {0,1} and every 


3 € P with domain S. and every a, € s* we say 


St G,, (a) (where i € (0,1) iff 8 F B, (a) when Ris. interpreted as 
Ge (restricted te 3); and &' is interpreted as Ge 3 we say 3b Gs, Ca) L£E 


St Fi (a) when & is interpreted as Gy and &." is interpreted. ag. G,. 


Theorem A.9: Let Fy,F,.Ej.F; be formulas of £" and let G(x,), G' ) 


be formulas of £ defining, reapectively, the properties G(x,) and 
~~ * : se _ 
G'(y,)- For each y € {0,1} , let G(x) and Gp) be as in Definition 


A.8. Assume that for any & € P, the relations obtained by restricting 


Gy and Gy to & are both nonempty. Then for each y € {0,1)* there exist 


Lr 


formulas g.. (x) » Sg yD such. that 
(I) G defines G and G' defines G'. 
~Y .Y ~Y Y 
“2 
(II) There is a procedure which given y € {0,1} computes Ss. and Gry 


within time a fixed polynomial in ly| and space linear in ly. 
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Proof: The basic idea of this proof is what we call "simultaneous 
definition"; for every y € (0,1}* we will write down a formula which 


defines both Gy and Cys as described below. 
For each y, let #29) be a 2k-place property. which we define 
informally to be "G(x,) A Gy) "; more formally, 1f 8 €P with domain 
S and ays b, € sk then we say 3 + H (a,b) oS 6 (a) and 
Sr G1 (by). The formula H,(x,5¥,) = G(x) A 6'G,) defines H,(x,,7;,)+ 
Let 6 € {0,1} and let i € {0,1}. We noe shoe estas (this will 
be made a tae rane how Hey can be expressed from Hy: ‘It is sufficient 
to show that Ge, and Gey can be eepecesed ae Hye Using E and Fi we 
can express Gy and Gea by using G, and Gr. Since oe = SEP 
with domain S and any a, € sk 
a G,(a,) @ for some b, € gk a H, (a, 5b,)> aa 
3 Fr Gs (a,) @ for adie by € gk 3k Hy (b. a5,” we see that G, and Ge 
. can be expressed from Hy 


Proceeding more formally, let £5 be the language of the first order 


, since the relations obtained by restricting Gs and Gs to & are nonempty. 
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predicate calculas obtained from £ by adding a 2k-place formal predicate JU. 
Let W,,Wos «++, W, be distinct variables not cuctiae in Fuk ek! ae 
For i € {0,1}, let F(x) be the formula of £ obtained from f, by 
substituting dw, aw, oees aw, UC») for Rv) -every time ® appears 


(where Vy2Voo eos Vy represent formal variables), and substituting 


Fw, Bw, ee aw, uU (wy 9 ¥,,) for R' (vy) every time R' appears; obtain 


#1 (,) from Fi in the game manner. 
For a € {0,1}, define the formula T, & sy) of { as 


Fx) A Fi (y)« One can now see that for Bb € (0,1)*, pa {0,1}, 


S$ €P with domain S, and aps, c sk, we have SF Gp, (a,) oS F, (a) 


“hn ' 
when U is interpreted as H, restricted to 8, $F G5, (b) o3hb FC - 


when U is interpreted as H, restricted to $, and therefore 


8 

SF Hy , (ay sb,) 28 T, (a,b) when U is interpreted as H, restricted to §. 
Now let (2425s see's Zoy) be a set of 2k distinct exteneee not 

intersecting {X42%o> sees XpeVpsVov coos yi) or the set of variables in 

Tg and T,. Let Tos ¥4) and Dy Gas %) be formulas of £) such that each 


contains exactly one occurrence of U, namely in the atomic formula Ulko)s 


5 APR eet ce oe ret 
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and such that I, is equivalent to T, and [° 


—-O0 


1 is eqitvatent to T,- 


Xy 
For every y € {0,1} * define the formula H Gy ¥,) of £ as follows. 

Let Hy (x +¥4.) be, as before, the formula G(x,)A 6G: se € (0,1)" 
and i € {0,1}, let H,, be the formula obtained by substituting, for 
the formula a, Oe eH) It is a to see that 
H Gs¥ 4) defines HO, 2%) for y € (0,1)". As 3 the proof of 
Theorem A.2, we can check that lz, | s cly| for ly| > 0. Lastly, for 


* a A Se 
y € {0,1} , let Gtx) be dy, 475 Sarg Ay HC 2%) and let c be 


ax 


1 *2 er Fx H (+75) It is clear that conditions (I) and 


(II) of Lemma A.9 hold. , , M7 
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Appendix 2: Notation 


The empty set. 

{x|x € A and x ¢ B} (set difference). 

The set of all subsets of the set A. 

The cardinality of the emu, 

The length of the string a. 

The absolute value of the integer n. 

The set of all strings over L if D is a finite alphabet. 

The empty string. 

ee Ee 

Goacetedatton of the strings a and y. 

The i + 1 (from the left) member of the string a. 

If a is a string, then a-a- ... -@ (k times) if k > 0 and A if k = 0. 
If S is a set, then S x Sx... XS (k times) if k > 0 and ¢ if k=O. 


(a) 949, eetaty a) if k > O and @ if k = 0. 
(e,e, ..., e€) (length k) if k > O and ¢ if k = 0. 


(e,e, ---, e) (length k) if k> 0 and gif k= 0. 
Maximum of the set A. 
Minimum of the set A. Min A = 0 if A = @. 


logo n. 
f(a) = f(b) => a = Db, 


For all b € B there is some a such that f(a) = b. 
The set of nonnegative integers. 
The set of integers. 


The set of real numbers. 


N 


DTIME(f(n)) 


NTIME(£(n)) 


DSPACE(£(n)) 


NSPACE(£ (n) ) 
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The structure <N, +, <, 0 >. 

The structure < Z, +, <, 0 >. 

The structure <R, +, <, 0 >. | 

A logical structure with domain S. 

The weak direct power of S. 

The domain of 8”. 

The strong direct power of 8. 

The Ehrenfeucht: equivalence relation (definition 2.2.1). 
Equal up to size n (definition 2.3.2). — 

Equivalence mod. k. 

The number of = equivalence classes on sk, 

The set of sentences true in 8. 

The set of sentences true in avery structure in the set P. 
F is true in 8. 

The norm of the element a of a logical structure. 

Finite abelian group. 

A (one tape, one head) Turing machine. 

A language recognized by MT. 

Polynomial time, linear space reducibility. 


The set of languages recognizable within time f(n) by a 
deterministic Turing machine. 


The set of languages recognizable within time f(n) by a non- 
deterministic Turing machine. 


The set of languages recognizable within space f(n) by a 
deterministic Turing machine. 


The set of languages recognizable within space f(n) by a non- 
deterministic Turing machine. 


SSS ES or 
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